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ABSTRACT 

The proposed activities of the Office of Research and 
Evaluation of the Austin (Texas) Independent School District in 
1990-91 are outlined. Evaluations and other major projects focus on: 
(1) externally funded projects; (2) systemwide achievement testing; 
and (3) systemwiae evaluation. Twelve evaluations will assess the 
impact of programs and grants funded by federal or state resources 
beyond the local district budget, including aspects of the Education 
Consolidation and Improvement Act. Testing programs mandated by state 
law and local policy will be coordinated and administered, including 
both nationally notmed tests and the Texas Assessment of Academic 
Skills. Di^tabases containing student, employee, and other school 
district information will be maintained and used to monitor local 
policies and mandates. This document presents all of the programs and 
requests included for study in 1^90-91, the resources allocated to 
each, and plan^ for those evaluations finally adopted. For each 
program, a brief description and relevant issues with related 
evaluation questions and information sources are outlined. Both 
budget implications and exemplary school practices were expected to 
influence all evaluations. (SLD) 
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THE RESEARCH AND EVALUATION AGENDA FOR AISD-1990-91 

EXECUTIVE SUMMARY 

The Research and Evaluation Agenda for the Austin Independent School District is dctennin^.d 
' through an interaaive process involving the Board of Trustees, the Superintendent, the Evah ation 
Advisory Committee, the Superintendent's Cabinet, the siafTof special programs, and other AISD 
personnel Although the activities of the OfTice of Research and Evaluation (ORE) constantly adjust 
to current needs and requests, a set of evaluation plans is prepared at the beginning of each school 
year as a means of obtaining agreement among decisionmakers that the proper and most critical 
information ne^ are being address^. These plans provide the blueprints for the evaluation staff to 
follo\v'. 

The evaluations and other major projects for 1990-91 will focus resources in three major areas* 

L ExiemaUy Funded Programs 

Twelve evaluations will assess the impaa of programs and grants funded by Federal or State 
resources beyond the local budget of AISD, The success of students receiving compensatory 
education and other special services will be ass^sed for Chapter 1 Supplementary Reading, 
Chapter 1 Schoohvide Projects (Priority Schools), Chapter 1 Migrant Program, Chapter 2 
Formula Programs, Pregnancy, Education, and Parenting (PEP) Pilot, Title VII Bilingual 
Education Transition Program, School-Community Guidance Center, Project GRAD (Grant 
Research About Dropouts), Drug-Free Schools, National Science Foundation (NSF) Grant for 
the Science Academy of Austin, and Texas Learning Technology Group (TLTG) Physical 
Science and Technology Project, The effer weness of training provided to teachers through 
Title II Mathematics and Science Teacher i raining will also be examined. 

2. Sysitmwide Achievement Testing 

Testing programs mandated by Siate law and local policy will be coordinated and administered. 
These testing programs include the Iowa Tests of Basic Skills (ITBS), Tests of Achievement and 
Profitiency (TAP), Metropolitan Readiness Tests (MRT), Texas Assessment of Academic Skills 
(TAAS), Computer Literacy Test (CoLT), and advanced placement tests. In addition, the 
systemwide testing staff will provide a scoring and reporting service for end-of-basal tests and 
TAAS practice tests at the elementary level, 

3, Systemwide Eraluation 

Data bases containing student, employee, and other District information will be maintained and 
used to monitor local policies and mandates such as faculty/staff recruitment goals, dropout 
prevention efforts, and programs for limited-English-proficient (LEP) students. Surveys of 
employees, students, and parents will be administered. An evaluation of the Project A+ 
Elementary Technology Demonstration Schools will be conducted. In addition, information will 
be provided in response to State reporting mandates such as the Annual Performance Report, 
HB1758 (required pasting of school district information). Public Education Infonnatioa Man- 
agement System (PEIMS), and the Superintendent's Annual Report GENeric Evaluatton 
SYStem (GENESYS) analyses will be performed as available resources permit from District 
data bases on outcome measures such as achievement, behavior, attendance, dropout rates, and 
promotion/graduation status for students in identifiable groups such as Teach and Reach, AIM 
High, Kealing Magnet Program, Science Academy, Ubcral Arts Academy, and others. 
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The 1990-91 budget for the Office of Research and Evaluation reflects a reduction of three and one- 
half positions including the Assistant Director oompared to three years ago. This has limited the col- 
lection and reporting of process (implementation) information, and has limited our ability to analyze 
and to explore why stuitent outcomes resulted as they did. We still have strong outcome evaluation- 
. especially with the development and refinement of GENESYS, oar '^generic'' evaluation system. 

The full Agenda document presents all the programs and requests included for study in 1990-91, the 
resources allocated to each, and evaluation plans for the evaluations adopted in the final Agenda, 
Twenty-three research and evaluation studies or activities are included in the 1990-91 Agenda. The 
Table of Contents lists evaluation plans for 20 of these. Separate plans are not included for Priority 
Schools (local)* Annual Performance Report/HB175^EIMS, and TAAS practice/eriu-of-book test 
scoring. Evaluation questions relating to the Priority Schools O^cal) study are contained in the 
Chapter 1 Priority Schools evaluation plan. Tlie other two items are described under the 'Other 
Aaivities* seaion. 

In addition to the evaluations outlined in this document and others that might be added as externally 
funded programs are approved, ORE will conduct many other research and evaluation activities not 
represented evaluation plans. These other activities range from conduaing an annual study of 
overlapping services to students, to assisting elementary school staff in completing the •Efl'eaive 
Schools Standards Report,' to meeting with school faculties to assist them in planning and staff 
development 

New Directions for 1990-91 

As ORE and its evaluation methodology continue to mature, and as the District experiences a 
renewal of interest in using evaluation findings, the following two new directions will influence all 
evaluations. 

1. Budget fpiplication^ 

llie Board of Trustees requested daring its review of this Agenda that ORE summarize its 
findings with budget implications and that ihe alternatives for action be matched to those 
findings. 

Z Exemplaiv School Practices 

Evaluations will study program outcomes by individual schools in addition to overall 
program outcomes. TTie purpose is to identify schools thai have been successful and to 
determine what made them successful. 
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INTRODUCTION 



The Austin Independent School District has made a commitn^cnt to research and evaluation for the 
past 17 years. The mission of the Ofllce of Research and Evaluation (ORE) is to provide objective, 
accurate information to decisionmakers. The information can range from an individual student's test 
scores to evaluation reports on instructional programs. IXcisionmukers can be as difTerent as a 
parent oonoenie<! about a cbild^s achievement and a federal funding agency. 

ORE provides an independent perspe^ive on AISD programs as guarantwrf by Administrative 
Regulation BL-R (Local) which states that ORE "'has the independence necessary to assure unbiased, 
forthright reports,** That independence is reinforce by ORE'S control over the selection of staff, the 
administration of funds, and the content of designs and reports. 

The purpose of this volume is to outline the proposed activities on which the Office of Research and 
Evaluation will focus in 1990-91. Three key areas will receive special attention this year: 

. Externally Funded Programs 
. Systcmwide Achievement Testing 
. Systemuidc Evaluation 



Setting the Agenda 



The prcKess for setting the 1990-91 Agenda is outlined below. 


June-October 1990 


ORE reports from 1989-90 are reviev^cd by staff, Cabinet, 




Board. 


June-October 1990 


Funding of external programs and grants is determined. 


August 1990 


Local budget resources are approved. 


September-October 1990 


Draft Agenda is prepared and reviewed. 




September 1-Oaober 9 Program Staff 




September 24 Evaluation Advisory 




Committee 




October 9 Cabinet 




October 22 Board of Trustees 


November 1990 


Final Agenda is prepared based upon review and comment. 
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A functional change finom past years was implemented for the third year. Instead of receiving a pol- 
ished Agenda after full review by other audiences, the Board of Trustees reviewed a draft Agenda 
earlier. This m^ the final Agenda iiK>re responsive to the suggestions of the Superintendent, Cabi* 
net, and Board of Trustees while maintaining the in-depth review by the program staff. Figure 1 on 
page 3 is a diart of Agenda items that have been reviewed. Attachment A describes each in terms of: 



Mandate: Required by School Board Policy? 

Required by State (law or SBOE rule)? 

Required by external funding agents 
(Sute/Federal)? 

Requested by Board? 

Requested by Superintendent/Cabinet? 

RequCv^ied by Hivision/departmcnts/schools? 

Evaluation need identified by ORE? 

Evaluability: Process Evaluation (implementation): 

Possible? 

Recommended by ORE? 

Product Evaluation (achievement /atlendanoe/behavior/other): 
Possible? 

R^x)mmended by ORE? 
VtiiUy: Does it provide newAiseful information? 

Is there potential for findings being used: 

Budgetary? 

Instructional? 

Can data be provided when needed? 
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Figure 1 

ORE AGENDA-SETTING PROCESS 1990-91 
Agenda Items for Which Resources Are Available 



ProgramfEraluaium Activity 
FacuIty/SlflfTRccruiimcnl Plan 
Pnority ScJkx* (Lcxral) 
Dropoul Prevention (lixal) 

Dtstrictwidc Employee, Student, and 
Pare Surveys 

S)-slcmwidc Testing 

Programs for LEP Students 

Annual PcrfcHinance Report/ 
HB1758/PEIMS 

Chapter 1 Supplcmentar)' 

Chapter 1 Priority Schools 

Chapter 1 Migrant 

Chapter 2 

Pregnancy, Education, and Parenting 

Titte VII Bilingual FxJucaticwi Transition 
Program 

School-Community Guidance Center 

Projea GRAD (Grant Research 
About Drc^xHJts) 

Drug-Free Schools 

National Science Foundation (Science 
Ac^my of Austin) 



Mandaie 

Required School Rxird policy 

Required by School Board policy 

Required by SchocM Board policy 
Required State (law or SBOE rule) 
Requested tiy Superintendent/Cabinet 
Requested by divisionsAkpu.^dKX>is 
Evaluatim need kJenttfl<^ by ORE 

Required by School Board policy 
Requested by Superintendent/Cabinet 
Requested by divisions/depts. /schools 

Required by School Board policy 
Required by State (law ex SBOE rule) 

Required by State (law or SBOE rule) 

Required by State (law or SBOE rule) 

Required by external funding agc jts 
Required by external funding agents 
Required by external funding agents 
Required by external funding agents 
Required by external funding agents 
Required by external funding agents 

Required by external funding agents 
Required by external funding agents 

Required external funding agents 
Required by external funding agents 
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FrogrumlEimiuation Adi^Uy 



MandaU 



Title II Mathematics and Science 
Teacher Training 



Required by external funding agents 



TLTG Physical Science and Technology 
Project 



Required external funding agents 



Projea A+ Elementary Technology 
Demonstration Schajls 



Required by external funding agents 
Requested by SupcrimendcniAI^binet 
Requested divisions depi&^schools 



GENeric Evaluation SYStem 



Requested 
Requested 

Evj'iatiOT 



Superintcodent/ Cabinet 
divisiCKis/de[Hs./sciKx>ls 
need identified by ORE 



(GENESYS) 



Historical Student Retention in Grade 



Requested 
Requested 
Evaluation 



by SuperintendcntA^abinct 
divisions/depisTschools 
need identified by ORE 



TAAS Practice and Eiid-of-Iiook 
Test SoMing 



Requested 



by divisions/depis,/schooU 



New Directions for 1990-91 

As ORE and its evaluation methodology continue to mature, and as the District experiences a 
renewal of interest in using evaluation findings, the following two new directions will influence all 
evaluations. 

1. Budget Implications 

The Board of Trustees r equested during its review of this Agenda that ORE summarize its 
findings with budget implications and that the alternatives for action be matched to those 
findings. 

2, Exemplary School Practices 

Evaluations wiJl study program outcomes by individual schools in addition to overall 
program outcomes. The purpose is to ider tify schools that have been successful and to 
determine what made them successful. 
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After reviewing these factors, we have selected the 23 items on the chart to include on the 1990-91 
Agenda, based upon available ORE resources. 

The two charts in Figure 2 below represent the distribution of resources, in terms of dollars, allocated 
10 externally and locally funded activities. 



FIGURE 2 



LOCAL BUOQET $535,569 (51%) 




DROPOUTS 9% 



EXTERNAL BUDGET $522,448 (49%) 



Chapter j ab% 




HIGHLIGHTS 



The 1990-91 Agenda will reflca the following important aaivities for ORE 

• Addition of an evaluation of the Project A+ Elementary Technology Demonsii aiion 
Schools 

' Addition of an anonymous survey of middle school students 

• Continuing priority given to providing requested information in an accurate and 
timely fashion 

. Continued implementation of a survey management system to provide longitudinal, 
campus-level summaries of school climate and other important factors from the 
perspectives of students, parents, professionals, and administrators 

' Continuing allocation of local resources to foctis on the dropout issue 

• Increased data collection/analyses in the Chapter 1, Chapter 1 Migrant, and Chaptc. 2 
evaluations mandated by new Federal reporting requirements 

• Continuing refinement of the GENeric Evaluation SYStem (GENES YS) to provide 
standardized outcome information to decisionmakers and program stan^on a large number 
and variety of programs and groups 

• Coordinating testing aaivities related to the first-ye: r administration of the Texas 
Assessment of Academic Skills (TAAS). The change to the TAAS will also include 
changes in practice tests used in elementary schools throughout the year. 

- Continuing effort to increase efficiency within current budget resources by fuller use of 
existing Distria data bases and by maximizing the utility of PC resources through the use 
of the latest technology such as presentation graphics, desktop publishing, and local area 
networks (LAN's) 

• Continuing dialogue with the Texas Education Agency to influence the test selection 
process such that the nonn-referenced test mandated for use across the State will best fit 
the District^ needs for student assessment 

. Monitoring the District's Vital signs,' i.e., the key statistics that reflect the instruaional 
'health* of the system, which include attendance, discipline, grades, the dropout rate, 
and performance on the Exit-Level TAAS 

• Continuing focus of the remainirig local resources on maintaining data bases for student, 
employee, and school information, and the generation of summaiy reports from them 
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OTHER ACTIVITIES 



Not all ORE activities are directly related to the production of a particular report or other pvblica. 
Uo^-kTaJT^^ are "invisiWe" to most observer, of the District sc^ne and must be acknowl- 
edged if the full picture of ORE is to be presented in the Agenda. 

nie Svstcmwide Testing Program is in some ways the most visible of the ORE components because 
IJ^rv^Xistud^^^^ fnd 4Vent of the District interacts with its products yet the ^"8^/ « J ^^^^^ 
^der^kfni^^staffispJLblypoorlyunde^^^^ In addition to coordinating th^^^^ 
of thTfowalLts of Basic Skills (ITBS). the Tests of Achievement and Proficiency (TAP), he 
Meiro^un Readiness Tests (MRT), the Texas Educational Assessment of Minimum Skills 
^Sr^^e T^^^ Skills (TAAS), Systemwide Testing scores the 

and 'Jap and provides standard ano requested analyses ofall tests given^m tests and 
TctMii^ih which the Systemwide Testing stafT will be involved in 1990-91 are hsted below: 

Achievement Tests 

Metropolitan Readiness Tests (MRT) 

Iowa Tests of Basic Skills (ITBS) 

Tests of Achievement and Proficiency (TAP) 

Texas Assessment of Academic tkills (TAAS) 

Texas Educational Assessment of Minimum Skills (TEAMS) 

Other Tests 

Computer Literacy Test (CoLT) 
Advanced Placement Tests 
Preliminary Scholastic Aptitude Test (PSAT) 
Scholastic Aptitude Test (SAT) 
American College Testing Program (ACT) 

Other Activities 
Scoring of TAAS Practice Tests 

Scoring of End-of-Basal Tests . 
Coordinating National Assessment of Educational Progress Testmg ^ , ^ e k- . 
Communicating with Elementaiy and Secondary Education to dissemmatc TAAS objcuivcs, 
measurement specifications, and test administration procedures 

All other components of ORE also engage in aaiviUes which are not reflected directly in evaluation 
^Lm pTcSmple. the Chapter 1 afd Chapter 2 evaluations devote considerate resources c ach 
prin^o prying infonnatioS necessaiy for the developmem of the project m^^^^^^^l'^^ 
Sng year, ofher activities are less directly related to the local programs bemg ^^^J^ J^^ 
^SoTen a.^ from an information need of the Board of Trustee, the S"PJ""»^«»J«^^^^Jf 
SbincT ^ing able to respond to the requests quickly and accurately b one of the ™ i«f /^nt 
^rtLrORE brings to the District. That ability is derived in part from the fact that the data 
^^J^^oZ manKo^cts has allowed ORE to develop a «,mputenz ^ fund of informat.cn 
that can be drawn upon for many different uses. 
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Other examples of the variety of activities which do not lead directly to evaluation reports but 
contribute to improvement can be found in the following list. 

Working with Elemeniaiy and Secondary Education to implement advanced plaoemeni 
tests and procedures 

Maintaining the computerized data base on Umited^English-Profldent (LEP)/ 
Language-Other-than-English (LOTE) students and providing information to central 
and school staf& as well as TEA 

Improving the utility of achievement reports provided to instructional staff 

Refining dropout record keeping and at-risk identification to meet new State reporting 
requirements 

Contributing to the coordination of districtwide data collection and reporting by partici- 
pation on the Information Services Committee 

Working with the other offices in the Department of Management Information to 
improve the flow of information to and from the campuses 

Monitoring aaivities associated with the School-Based Improvement (SBl) initiative 
Maintaining an on-line data base of school characteristics for use by campus personnel 
Conduaing needs assessments 

Working as committee members on District projects such as Momentum Teams for 
Project A+ 

Working with other AISD central offices, including Intergovernmental Relations, Ele- 
mentary Education, and Secondary Education, to assist in the acquisition of federal and 
state grants for special student programs such as Title II Math/Science, Title VII, and 
Drug-Free Schools 

Working with the Evaluation Advisoiy Committee (EAC) composed of teachers, princi- 
pals, university professors, and lay citizens charged with the oversight of ORE^ activities 

Working on a sj aematic approach to providing information in order to move toward an 
"information on demand** environment 

Providing staff development assistance to campus«, departments, principal groups, and 
other school district suff 

Preparing of the Effective Schools Standards Reports and other profiles for all elemen- 
tary and seoondaiy campuses 

Providing review of TEA studies in the formative stages 
Conductii^g a study of multiple (overlapping) services to students 
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Completing TEA studies mandated by the Legislature 
Maintaining data Gles of students in major special programs 

Providing information for analysis by external, non-AISD researchers 

Contributing to educational improvement through participation in or sharing informa- 
tion with statewide and national organization, /hidi address issues that impaa AISD 
(i.e*, Joint Urban Evaluation Council, statewide Student Assessment Advisory Commit- 
tee, National Assodation of Test Directors, Directors of Research and Evaluation, 
South^^t Educational Research Association, American Educational Research Associa* 
tion, Annual Texas Testing Conference, Texas Association of School Boards, National 
Dropout Prevention Network, etc) 

Sending requested copies of ORE reports and papers to interested persons worldwide. 
During 1989-90, a total of 174 requests were made for copies of 78 ORE reports and 219 
requests for copies of 28 dilTerent papers presented at the meetings of the American 
Educational Research Association 

Responding to requests for information from AISD staff and others, both in the local 
community and aaoss the country 

Serving as a liaison with TEA to receive, interpret, and implement rules and regulations 
regarding student assessment 

Consulting with stall on planning for next school year 

Working with Secondary Education to develop a "school profile* of management infor- 
mation for each secondary campus 

Working with other offices in the Department of Management Information to produce a 
notebook in June for each elementary and secondary campus containing a wide range of 
data from the school year 

Providing information in response to State-reporting mandates such as the Annual 
Performance Report (APR), HB 1758 (required pasting of school distria information), 
and the Public Education Information Management System (PEIMS) 

Preparing information for and ccntributing to the Cbngressionally mandated Coopera- 
tive Education Data Collection and Reporting Standards (CEDCARS) which will be 
national standards for the conduct of research and evaluation 

Producing school profiles, detailed achievement reports by grade, test, and ethnic group 
for each campus 
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PROGRAM DESCRIPTION 

The Chapter 1 Program is a continuing program sup- 
ported by funds from the Department of Education unUt r 
the Elementary Consolidation and Improvement Act 
(ECIA). The purpose of Chapter 1 is to provide for the 
learning needs of educationally disadvantaged siudenis in 
school attendance areas having high concentrations of 
children from low-income families. Chapter 1 provides 
supplemental assistance to the regular schm)l program. 
AlSD's funding from Chapter 1 for 1990-91 is $4,900,374. 

Participation of schools in AlSD's Chapter 1 Program is 
determined by economic criteria. Schools which have a 
higher concentration of low-income families than the 
District average are eligible to receive Chapter 1 services. 
The schools are then ranked by the percent of low-income 
students who reside in their attendance areas. Then based 
upon the amount of Chapter 1 resources, services are 
provided to those schools with the highest percent of low- 
income families on down until the resources are ex- 
hausted. Standardized test results are then used to deter- 
mine how many students to serve at each school. Partici- 
pants ire identified by ranking the students at each school 
and selecting those with the greatest need (i.e., lowest 
reading percentile score). 

Full-Day Prekindergarten 

The State funds half-day prekindergarten for all low- 
income and limited-English-proficient (LEP) students. In 
the eight Chapter 1 supplementary schools, the Walnut 
Creek Schoolwide Project, and the 16 Schoolwide 
Project/Priority Schools, Chapter 1 will fund the after- 
noon session, to allow students eligible for Chapter 1 in 
these schools to have a full-day prekindergarten experi- 
ence. 

Chapter 1 Supplementary Reading Instruction 
Component 

The main objective of this instructional component is to 
improve Chapter 1 students' reading skills. This compo- 
nent is supplementary to and coordinated with the 
District's basic reading pro^j;ram. Us primary purpose is to 
provide additional assistance to students deficient in 
language and/or reading skills. During the 1990-91 school 
year, Chapter 1 services will be provided to eligible 
students in this manner in eight elementary schools. 
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ECIA CHAPTER 1 



EVALUATION PLAN 



Contact l*erson; 

Catherine Christner, Ph.D. 
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Program 
Description 
continued 



Schoolwide Projects/Priority Schools 
In a Sdiootwidc Project, Chapter 1 funds are combined 
with local funds to km^r the pupil-te^her ratio, and 
Chapter 1 instruction no longer distinguishable from 
regular instruction. Ail students in the school are consid- 
ered to be sermi by Chapter 1* Oiapter 1 is funding 
sdioolwide projects at 15 of the 16 Pitority Schools for 
1990-91. Although not a District*fund^ Priority School, 
Walnut Creek is a Chapter 1 Schoohvide project with a 
lower pupil teacher ratio. 

Parental Involvement 

Chapter 1 staff and parents decided to consuh with each 
other through Chapter 1 Districtwide Parental Advisory 
Council (PAC) meetings several times during the 1990*91 
school yean In this manner, parents can advise the District 
in the planning and the operation of the programs, as well 
as receive up-tonlate information and training on areas of 
interest-helping their children with reading at home, etc 

Nonpublic Schools 

A computer-assisted instruction laboratory, Prescription 
Learning, is provided to one nonpublic school This school 
provides Chapter 1 service to low>achieving students who 
reside in the attendance areas of Chapter 1 public schools. 
Qualified students receive instruction in reading and/or 
mathematics. 



Institutions for the Neglected or Delinquent 

Chapter 1 funds are provided to six institutions for ne- 
glected or delinquent students to fund support services for 
students with emotional, psychological, and behavioral 
problems. 

This plan contains summary information from the ECIA 
Chapter l/Chapter 1 Migrant 1990-91 Evaluation Design 
(ORE Publication 90,02), 
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Decision I Should the Prekindergarten Component be modified? 
Question I If so, how? 



The evaluation questions for the current year's prekindergarten (pre-K) program are 
in the evaluation outline for the Priority Schools. 



EVALVA TION QUESTIONS 

1-1. What have been the long-term 
longitudinal eflects of {Mrticipa- 
tion in AISD'a prekindergarten 
programs? How do they com- 
pare with similar students who 
did not participate in prc-K: 

On achievement test scores? 
On special education 
placement? 

On Chapter 1 eligibility? 
On retention? 
On LEP status? 



INFORMA TION SOURCES 

Prekindergarten File 
(ongoing) 



Iowa Tests of Basic Skills (I VBS) (April) 
Special Education File (oiigoing) 

Chapter 1 File (ongoing) 
Distria Records (ongoing) 
LANG File (ongoing) 
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Decision I Should AISD change the structures and approaches tradi- 
Question | tionally used in Chapter 1? 



EVALUATION QUESTIONS 



IN FORMA TION SOURCES 



2- L Were ihe objeeiives of ihc 
Chapter 1 Supplemenlaiy 
Reading Instruction Component 
met? 



lo>\'a Tests of Basic Skills 
(ITBS) (April) 
Record of Student Service 
(ROSS) (ongoing) 



2-2- How do students in grades 3 and 
5 who were served by Chapter 1 
compare on TAAS sa>res with 
similar students as a whole? 



Texas Assessment of 
Academic Skills (TAAS) 
(Oct, 1990) 



2-3, How did the TAAS achievement 
of Chapter 1 -served students in 
1990-91 compare with the 
achievement of other low 
achieving stadcnis not served by 
Chapter 1. 



TAAS (Oct, 1990) 



2-4. What percentage of Chapter 1 
students become eligible for the 
1991-92 Chapter 1 Program 
based on their spring ^91 ITBS 
scores? How did this compare to 
last year? 



ROSS (ongoing) 
ITBS (April) 



2-5. What percentage of former 
Chapter 1 students reenter or 
odt the program in following 
years? 



Chapter 1 File (ongoing) 
ITBS (April) 



2-6. Were there by-campus differ* 
ences in the achievement gains 
of Chapter 1 students? 



ROSS (ongoing) 
ITBS (April) 



2-7. How do the achievement gains 
made by Chapter 1 students 
compare with gains by Chapter 1 
Migrant stwlents? 



ROSS (ongoing) 
Migrant File (ongoing) 
ITBS (April) 
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Should AISD change the structure and approaches tradi- 
Question I tionally used in Chapter 1? 



2 



EVALUATION QUESTIONS 



INFORMA TION SOURCES 



2-8, How successful was implcmcnia- 
lion of ihe Chapter 1/Chaplcr 1 
Migrant Inslruciional Programs? 

Whai oonams/sirenglhs 
were identified by Chapter 1/ 
Chapter 1 Migrant Teachers? 

What concems/strengths 
were identified by Chapter 1/ 
Chapter 1 Migrant 
administrative staff? 



Teacher Survey (spring) 



Administrative Staff 
Interview (spring) 



1-9. What schools (by grade and 
subject area) participated in 
Rainbow Kits? At each school, 
who was responsible for distribu- 
tion? What was funded by 
Chapter 1? How were the kits 
used? What evidence is there of 
the kits* effcaiveness? 



Administrative Staff 
Interview (spring) 



2-10, How successful was the imple- 
mentation of the Chapter 1 
Schoolwide Project at Walnut 
Creek? 

2- 1 1 What is the average oc^t of the 
program per estimated student 
contact hour? 

2-12. How successful have the Chapter 
1 Programs been in improving 
students achievement levels 
longitudinally? 



Principal Interview (spring^ 
Administrative Staff Inter- 
view (spring) 

Teacher Interview (spring) 

RC i (ongoing) 
Chapter 1 Application for 
Funding (August) 

ITBS (April) 

Longitudinal Chapter 1 File 
(ongoing) 
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Decision I Should Chapter 1 change the way students and schools are 
Quesnon \ selected? 



EVALUATION QUESTIONS 



IN FORMA TION SOURCES 



3-1 How many sludcnis were served 
at each grade level by gender, 
eihnicity, and type of service 
(learn leaching, puHout, or 
Ixnh)? 



ROSS (ongoing) 



3-2. How many sludenis were special 
icslcd? Why? Did sludenis 
lesied differ by grade, elhniciiy, 
or gender? 



Special Test File (ongoing) 



3-3, Whai percentage of Chapter 1- 
eligible students are low- 
income? 

3-4. What number and percentage of 
students eligible for Chapter 1 
service received supplementary 
instruction from a.^oihcr source? 



ROSS (ongoing) 
Cafeteria File (January) 



Overlap Study (December) 



3-5, What percentage of eligible 
students are served by 
Chapter 1? What percentage of 
eligible LEP students are served 
by Chapter 1? How does this 
compare with last year's figure? 
Is there by-campus variation in 
the percentage of eligible 
students served? 



ROSS (ongoing) 
LANG (spring) 
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What other programs/labs q>erate in the Chapter 1 Schools? 



EVALUATION QUESTIONS 



IN FORMA TION SOURCES 



4-1, Whal CAI labs are on Chapter 1 
campuses? 

4-2. Whal oiher special programs / 
labs operate in the Chapter 1 
schools? 



Coordinator Interview (fall) 



Coordinator Interview (fall) 



4-3. What evidence is there of 
program/lab eflectivencss? 



Coordinator Interview (fall) 
ITBS (April) 

Lab survey (spring) 



Decision 
Question 
5 



Should the Parental Involvement Component be 
modified? If so, how? 



5-1, Were the component's objectives 
met? 



5-2, How many Chapter 1 Dis- 
triawide PAC meetings and 
training sessions were held 
between Aug. 27, 1990 and May 
31,1991? 

5-3, Did more Chapter 1 parents 

attend Districtwide PAC meet- 
ing during 1990-91 than they 
did during 1989-90? 

5-4. How successful was the 

implementation of the Parental 
Involvement Component? 

What ooneems/strengths 
were identified by Chapter 1 
siafl? 



PAC Records (ongoing) 
Administrative Staff 
Interview (spring) 

PAC Records (ongoing) 



PAC Records (ongoing) 



Administrative Staff 
Interview (spring). 
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Decision 
Question 
6 



Should the Chapter 1 Nonpublic Schools Component be 
modified? If so, how? 



EVAL UA TiON QUESTIONS 

6-1. Were the componeni's objectives 
met? 



6-2 How many students were served 
by the Chapter 1 nonpublic 
schools by age, grade, gender, 
and ethnicity? 



IN FORMA TION SOURCES 

Chapter 1 Service Report 
for Nonpublic Schools 
(spring) 

Chapter 1 Service Report 
for Nonpublic Schools 
(spring) 



6-3. What evidence is there that Chapter 1 Service Report 

nonpublic school students for Nonpublic Schools 

receiving Chapter 1 service made (spring) 
achievement gains? 



6-4. How successful was the imple- 
mentation of this component? 

. What concerns^trengths Administrative Staff 

were identified by Chapter 1 Interview (spring) 

staff.^ 
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Decision 
Question 
7 



Should the Chapter 1 Component for Institutions for 
Neglected or Delinquent (N or D) Youth be modified? If 
so, how? 



EVALUA TION QUESTIONS 



IN FORMA TION SOURCES 



lA. Were ihe comi>oncnrs objectives 
met? 



Chapter 1 N or D Service 
Report (spring) 



7-2, How many sludenls were served 
by ihc Chapter 1 N or Ds-by 
age, gender, grade, and dhnic- 
ity? 



Chapter 1 N or D Service 
Report (spring) 



7'-\ Whai are the goals and objec- 
tives of Chapter 1 services at 
these instituticiis? 

. How successful were these 
institutions in achieving their 
goals? 



Interviews with the 
administrative staff of N or 
Ds (fall, spring) 



How successful were the 
served N or D students? 



7-4, How successful was the 
implementation of this 
component? 



Administrative Staff 
Interview (spring) 
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Information I Needs Assessment for the 1991-92 Chapter 1 Application 
Needs I 



EVALUATION QUESTIONS 



IN FORMA TION SOURCES 



Whai percentage of the 
students residing in each AISD 
attendance area are from low- 
income families? 



Student Master File 
(ongoing) 

Cafeteria File (ongoing) 



How many students in each 
school scored below selected 
percentile points on the ITBS? 



Student Master File 

(ongoing) 

ITBS (April) 



How many students would be 
eligible for Chapter 1 services 
for various combinations of 
criteria for campus and student 
eligibility? 



ITBS (April) 



Information 
Needs 



Annual Program Documentation for the Texas 
Education Agency 



EVALUA TION QUESTIONS 



INFORMA TION SOURCES 



1 . How many students were served 
(by grade, gender, ethnicity, and 
age) by Chapter 1, including 
service at nonpublic schools and 
at N or Ds? 



ROSS (ongoing) 
Chapter 1 Service Report 
for Nonpublic Schools 
(spring) 

Chapter 1 N or D Service 
Report (spring) 



What were the achievement 
gains for students served by 
Chapter 1 during 1990-91 in 
Normal C^rve Equivalents 
(NCE)7 



ROSS (ongoing) 
ITBS (April) 
Chapter 1 Service Report 
for Nonpublic Schools 
(spring) 
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Annual Program Documentation for the Texas 
Education Agency 



EVALUA TION QUESTIONS INFORMA TION SOURCES 



3, How do achicvemenl gains from ROSS (ongoing) 

1989 lo 1990 compare for slu- ' ITBS (April) 

dents served by Chapter 1 in 
1988-89 (but not 1989-90) with 
students served by Chapter 1 in 
both 1988-89 and 1989-90 in 
NCEs? 



4, What were the achievement 
gains lor students served by 
Chapter 1 (supplementary and 
SWP^) in NCEs by grade and by 
campus? 



5, For those Chapter 1 campuses 
with one or more grade leveis 
below the expected gains» what 
were their campus improvement 
plans? 

6. How many students served by ' Student Master File (June) 
Chapter 1 (supplementary and 

S WP's) were retained, by grade. 



7. How many students served by Overlap Study (Dec.) 

Chapter 1 (supplementary and 
SWP^) were also served by 
Special Education (by handicap- 
ping condition)? 



Information 
Needs 



ROSS (ongoing) 
- ITBS (April) 



Campus Improvement Plans 
(fall) 
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PRIORITY SCHOOLS 



EVALUATION PLAN 



Contflct Person: 

Catherine Christner, Ph.D. 



PROGRAM DESCRIPTION 

In the spring of \9SC, when the School Board approved a 
new student assignment plan for 1987-88, 16 predomi- 
nantly minority elemeniary schools were created. In order 
to assure that students in these schools received a quality 
education, the Division of Elementary Education devel- 
oped A Plan for Educational Excellence, with the advice 
of a committee of teachers, principals, and other adminis- 
trators. The plan is based on the characteristics of 
effective schools. There are 10 components that make up 
the plan: 

• Exemplary Leadership and Master Teachers 

• Effective instruction 

• Full-Day Prckindergarten 

• Reduced Pupil-Teacher Ratio 

• Additional Personnel and Support Services 
^ Multicultural Education 

• Strong Parental-Community Involvement 

• Staff Development 

• Building/Grounds 

• Accountability 

1990-91 represents the fourth year of implementation of 
the Priority Schools. The evaluation plan is organized 
with one d^sion question and a set of evaluation ques- 
tions for each component This plan represents a combi- 
nation of both outcome and process measures wiih a focus 
on outcome variables. 



r ^ 
Ierlc 



90.07 




Should the Exemplary Leadership and Master Teachers 
Component be continued as it is or be modified? 



EVALUATION QUESTIONS 



INFORMA TION SOURCES 



\A . How did the school climate of 
the Priority Schools compare to 
the school climate at the other 
elementary schools? 



Teacher Survey (spring) 



1 -2. Did principals work with their 
staffs and communities to 
establish a mission for their 
schools? Was the mission 
communicated to staff and 
parents? 



Teacher Survey (spring) 
Principal Interview (spring) 
Parent Survey (March) 



1-3. How many teachers at the 

Priority Schools were bilingually 
or ESL certified? 



En.ploycc Master Record 
(EMR) File (ongoing) 



1 -4. How did the teacher absentee 
rate at the Priority Schools 
compare to the rate for other 
elementary schools? 



EMR File (ongoing) 



1-5. How did the absentee rate for 
the teachers at the Priority 
Schools compare with the same 
teachers' absentee rale in 1989- 
90? 



EMR File (ongoing) 



1-6, How did the teacher transfer 
request rate for the Priority 
Schools compare with the 
transfer request rate in the rest 
of the District? 



EMR File (ongoing) 
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Dedriort 1 Should the Exemplary Leadership and Master Teachers 
Component be continued as it is or be modified? 



EVALUATION QUESTIONS 

Whai was ihe ethnic composi- 
tion of teachers assigned to the 

schools? 



How experienced were teachers 
assigned to the Priority Schools? 
How did this compare with other 
elementary schools? 



IN FORMA TION SOURCES 
EMR File (ongoing) 

EMR File (ongoing) 



1-9, What degrees were held by • EMR File (ongoing) 

.iiachers assigned to the Priority 
Schools? 
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Should the Effective Instruction Component be continued 
as it is or be modified? 



EVAL UA TION QUESTIONS 



INFORMA TION SOURCES 



2-1. What achievement levels did 

students make in 1990-91? What 
gains did they make from 1986- 
87? From 1987-88? From 1988- 
89? From 1989-90? By grade? 
By ethnicity? By campus? By 
income status? 



Iowa Tests of Basic Skills 
(ITBS) (April) 



How did the gains of these 
students made this year compare 
with their gains made last year? 
With the average elementary 
districtwide gains? With pre- 
dicted gains? 



Reptjrt of School Effective- 
ness (ROSE) (May) 
ITBS (April) 



2-3. What effect did lowering the 
pupil-teacher ratio have on 
students' achievement? 



2-4. How did the Priority Schools 
individually and as a group 
perform on the Effective School 
Standards Report? How do 
these figures compare to 1987- 
88, 1988-89, 1989-90? 



ITBS (April) 

Attendance File (ATND) 
(ongoing) 
ROSE (May) 

EMR File (ongoing) 
ATND (ongoing) 
ITBS (April) 
Texas Ass<»sment of 
Academic Skills (TAAS) 
(Oct.) 



2-5. What TAAS mastery was shown 
by grade level? By LEP stu- 
dents? By campus? By ethnic- 
ity? 



TAAS (Oct.) 
Language File (LANG) 
(ongoing) 



2-6. How did these mastery percent- 
ages compare lo AISD as a 
whole? To ihe State? 



TAAS (Oct) 

State Averages (June) 
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Dediri^ Should the Effective Instruction Component be continued 
^"^ff^^^ Jl as it is or be modifed? 



EVALUATION QUESTIONS 

I'l. Whai TAAS masiery levels did 
this year's grades 3 and S 
siudcnis show? How do ihcsc 
compare wiih ihc TEAMS 
mastery levels for previous 
years? By campus? 



INFORMA TION SOURCES 

TAAS (Oct.) 
Texas Assessment of 
Minimum Skills (TEAMS) 
(1990) 



What percentage of LEP grade 3 
students tested in Spanish 
mastered the TAAS? Compared 
to AISD? Compared to the 
State? 



TAAS (Spanish) (Oci.) 
State Averages (June) 



2-9. What special programs were in 
place at these campuses? 



Overlap Siudy (December) 



2-10. How many special education 
students by handicapping 
condition were served? 



Special Education Manage- 
ment System (SEMS) 
(ongoing) 



211, What computer labs were in 

place at these campuses? What 
were the criteria for service? 
What other special programs 
were in place (i.e., A-f , EMG, 
etc.)? 



Principal Interview (spring) 
Coordinator Interview 
(Spring) 



2' 12. How many LEP students were 
enrolled in the Priority Schools 
during the 1989-90 school year? 



LANG File (ongoing) 



2-13. How many students participated 
in AIM High at grades 2-6? 
How does this compare with 
other elementary campuses? 



AIM High File (ongoing) 




B5 



.n 



90.07 



Decision I Should the Effective Instruction Component be continued 
Question | as it is or be modified? 



EVALUA TION QUESTIONS 



IN FORMA TION SOURCES 



2-14, How was ihe giftcdAalentcd 
program implcinentcd ai each 
campus? What changes were 
made from 1989-90? Were any 
problems with grouping or other 
areas encountered? 



Principal Interview (spring) 
Teacher Survey (spring) 
Gifted/Talented Coordina- 
lor-Interview(spring) 



2-15. What were the student atten- 
dance rates? How did this 
compare by campus and with the 
Distria? How did student's 
attendance rates this year 
compare with their attendance 
rates last year? 



ATND File 
(ongoing) 



2 16. What discipline incidents were 
processed? By campus? How did 
this compare with the district- 
wide rates? How do students' 
processed discipline incidences 
compare this year with their 
incidences processed last year? 



Discipline File (ongoing) 



2- 1 7. What were the promotion/ 
retention/placement rates for 
each of the Priority Schools? 
How does this compare with 
other AISD elementary schools? 



Student Master File (June) 



2-18. How many meetings did the 16 
principals have over the school 
year? What were the agendas of 
these meetings? 



Meeting Agendas (June) 
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Q^^g^^ I Should the Effective Instruction Component be continued as 
2 I it is or be modified? 



EVALUATION QUESTIONS 



IN FORMA TION SOURCES 



2-19, How did principals work wilh 
their staffs to emphasize and 
focus on maintaining their gains 
in the fourth year? How were 
new teachers trained/oriented? 



Principal Interview (spring) 
Teacher Survey (spring) 



2-20. What percent of the day did 

teachers use whole class instruc- 
tion? Heterogeneous grouping? 
Homogeneous grouping? 
Personalized/individualized 
instruction? 



Teacher Survey (spring) 
Principal Interview (spring) 



2-2 L How often did regrouping 

occur? Did this differ by grade? 
By campus? 



Teacher Survey (spring) 
Principal Interview (spring) 



2-22. How was the LAMP imple- 
mented? Were all the neeued 
materials available when 
needed? What were the 
strengths of the implementa- 
tion? What areas were in need 
of improvement? Is there 
evidence of program effective- 
ness? 



Principal Interview (spring) 
Teacher Survey (spring) 
Coordinator Interview 
(spring) 



2-23. How was on-grade instruction 
implemented at each school? 
How was on-grade level instruc- 
tion incorporated into the 
LAMP? Were there differences 
by grade? Bycamptis? Is there 
evidence of program effective- 
ness? 



Principal Interview (spring) 
Teacher Survey (spring) 
Coordinator Interview 
(spring) 
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0<cs^ Should the Full-Day Prekindergai ten Component be 
i ■ • 1 continued as it is or be modified? 



EVALUA TION QUESTIONS 



INFORMA TION SOURCES 



3-1 . How many students were served 
by the regular, bilingual, and 
ESL prekindcrgarien classes? 
By age, gender, ethnicity, and 
schools? By full-day and hair- 
day classes? 



ATND (ongoing) 
Student Demographic File 
(STUD) (ongoing) 



3-2. What was the average number of 
days of instruction received by 
prckindergarten students? Did 
this vary by type of class? By 
full-day/half-day? 



ATND (ongoing) 



3-3, How did the pre- to posttcst 
gains made on the PPVT-R by 
pre-K students compare to the 
national norm? To previous 
years? Across the three types of 
classes? Across varying prciest 
levels? 



Pcabody Picture Vocabulary 
Test-Revised (PPVT-R) 
(Sept., Oct., April, May) 



3-4, How did the pre- to posttcst 
gains made on the PPVT-R by 
students compare in the full-day 
and half-day classes? 



PPVT-R (Sept,, Oct., April. 
May) 



3-5. For Spanish monolingual LEP A 
and B students who took the 
Spanish TVIP and the English 
PPVT-R, how did pre- to 
posttesi gains compare? 



Test de Vocabulario en 
Imagenes Peabody (TVIP) 
(Sept., Oct., April, May) 
PPVT-R (Sept., Oct., April, 
May) 

LANG File (ongoing) 



3-6, What were the strengths and the 
areas in need of improvement in 
the implementation of the pre-K 
component? 



Teacher Survey (spring) 
Coordinator Interview 
(spring) 
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Decision 

Question I Should the Full-Day Prekindergarten Component be 
3 I continued as it is or be modified? 



EVALVA TION QUESTIONS 

3-1. What were the certification and 
experience levels cf the pre-K 
teachers? 



IN FORMA TION SOURCES 
EMR File (ongoing) 



3-8. What arc the most appropriate 
measures of achievement for 
prekindergarteners? 



Search (ongoing) 



Decision 
Question 
4 



Should the Reduced Pupil-Teacher Ratio (PTR) 
Component be continued as it is or be modified? 



4-1. What PTR was achieved ai each 
grade level at each campus? Did 
this match the prescribed levels? 



District Records (May) 



4-2, What emphases (training, etc.) 

occurred at the campuses to help 
teachers make the most in- 
struaionally of the lowered 
PTR? 



Principal Interview (spring) 
Coordinator Interview (fall) 
Teacher Survey (spring) 
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Decision 
Question 
5 



Should the Additional Personnel Component be 
continued as it is or be modified? 



EVALUATION QUESTIONS 

5-1. If any innovative funds were 
carried over lo the 1990-91 
school year, for what were the 
funds used? 



5-2. How were the 1990-91 innova- 
tive funds used? 



IN FORMA TION SOURCES 

Principal Interview (spring) 
Finance Rewrds (May) 



Principal Interview (spring) 
Finance Records (May) 



Decision 
Question 
6 



Should the Multicultural Education Component be 
continued as it is or be modified? 



6-1. What activities (how many and 
what type,) were conducted at 
the scho jIs to recognize and 
honor ihe students* own cultural 
herit'jges and to honor the 
cx)niributions of Blacks and 
Hispanics to society? 



Principal Interview (spring) 
Teacher Survey (spring) 
Coordinator Interview 
(spring) 



6-2, What multicultural activities 

(how many and what types) took 
plac£ at the school within the 
regular instructional program? 
What activities were held to 
recognize other cultural heri- 
tages? What other cultures were 
recogiiized and how many 
activities were held? 



Prindpal Interview (spring) 
Teacher Sur#'ey (spring) 
Coordinator Interview 
(spring) 



6-3* What multicultural activities 
took place across schools 
(number and type)? With other 
Priority Schools? With non- 
Priority Schools? 



Supervising Princij^l 
Interview (spring) 
Principal Interview (spring) 
Teacher Survey (spring) 
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Should the Strong Parental-Community Involvement 
Component be continued as it is or be modified? 




EVALUATION QUESTIONS 

7-1. Whal acliviiies occurred at each 
campus lo involve parents and 
community members? 



IN FORMA TION SOURCES 

Parent Training Specialist 
(PTS) Survey (spring) 
Principal Interview (spring) 



7-2. What arc the most innovative 
activities the schools imple- 
mented in this area? 



PTS Survey (spring) 
Principal Interview (spring) 



7-3. How many adopters did each 
campus have? What did adopt- 
ers provide? Were there changes 
from 1989-90? 



Adopl-A-School Records 
(June) 



7-4. Whal were the strengths and the 
areas in need of improvement in 
the implementation of this 
component? 



Principal Interview (spring) 
PTS Survey (spring) 
Parent Survey (March) 



7-5. What do parents think of their 
child's school situation? 



Parent Survey (March) 
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Decisiofi 

jgwtff^win 1 Should the Staff Development Component be contin- 
8 I ued as it is or be modified? 



EVALUATION QUESTIONS 



IN FORMA TION SOURCES 



8-1, What staff development activi- 
ties were offered at the campus 
level? 



Supervising Principal 
Interview (spring) 
Principal Interview (spring) 



8-2. Did teachers perceive the staff 
development offered as increas- 
ing their effectiveness as teach- 



ers? 



Teacher Survey (spring) 



8-3, Did principals and the support 
staffs perceive the staff develop- 
ment offered as increasing their 
effectiveness? 



Administrator Survey 
(spring) 

Support Staff Survey 
(spring) 



8-4, How closely did the staff devel- 
opment offered match the 
perceived needs at each campus? 



Teacher Survey (spring) 
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Dedsvoti 

^u^st^^^^A Should the Building and Grounds Component be 
9 I continued as it is or be modified? 



EVALUA TION QUESTIONS 



IN FORMA TION SOURCES 



9- 1 , Were any portables buili or 
moved lo the Priority Schools 
for the 1990-91 school year? 



Construction Management 
Records (June) 



9-2. Did any major cx)tistruction or 
repair projects occur at the 
Priority Schools for the 1990-91 
school year? 



Construction Management 
Records (June) 



Decision 
Question 



Should the Accountability Component be continued as it 
is or be modified? 



lO-L What evaluation plan was in 
place? 



Office of Research and 
Evaluation (ORE) 
(October) 



10-2. Was an evaluation report 
published? 



ORE (Augu>i) 



10-3, How many meetings did the 
monitoring committee hold? 
What have been the agendas? 



Monitoring Ct^mmii^'c 
Records (June) 



10-4, What schools were the most 

successful? What schools were 
the least successful? What 
characterized the most successful 
schools? What characterized the 
least successful schools? 



ITBS (April) 
TAAS (October) 
Elective School Standards 
Report (June) 
Supervising Principal 
Interview (spring) 
Coordinator Interview (fall) 
Principal Interview (spring) 
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Decision- 
Question 



Should the Accountability Component be continued as 
it is or be modified? 



EVAL UA TION QUESTIONS 



IN FORMA TION SOURCES 



10-5- Did ihc Frioriiy Schools mcci 
the Stale Board goals for 
schools? 



ITBS (April) 
TAAS (Oci.) 



Did each schcx)rs overai! 
performance increase an 
average of 8 perceniilc 
poinis on ihe ITBS relative 
10 ihe national norm? 

Did the percentage of 
students scoring 10% or 
more above the minimum 
TAAS passing score rise by 
1 percentage point? 

Did 40% of the students 
passing the TEAMS meet 
the State Board standards 
for meeting mastery of 
higher order thinking skills? 



10-6. How did the supervising princi- 
pals assist and monitor each 
school's goals-setting process? 



Supervising Principal 
Interview (spring) 



10-7. What expectations were commu- 
nicated in writing to the princi- 
pals on the implementation of 
the components? 



Instructional Memoranda 
(ongoing) 



10^8. What was the allocated cost of 
each component? 



AISD Budget (August) 
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ECIA CHAPTER 1 
MIGRANT 



EVALUATION PLAN 



Conlact Person; 

I Catherine Christner, Ph.D. 



PROGRAM DESCRIPTIOJ-^ 



I>erinition 

The Chapter 1 Migrant Program is a federally funded 
projca designed !^ mcei ihe unique needs of the District's 
migrant siudcntf . <>oth currently migratory and formerly 
migratory chilu; ^ ;i may be served by the Migrant Program. 
A currently m'gratory child is one (a) whose parent or 
guardian is a migratory agricultural worker or migratory 
fisher; and (b) who has moved within the past 12 months 
from one school district to another to enable the child, the 
child's guardian, or a member of the child's immediate 
family to obtain temporary or seasonal employment in an 
agricultural or fishing activity. Students who remain in 
the District following their year of current eligibility are 
considered formerly migratory students for a period of five 
years. Currently and formerly migratory students arc 
eligible for the same program services. For 1990-91 the 
funding level decreased to $323,621, 

The activities of the Migrant Program arc centered 
around: 

* Recruitment of students and parental involvement, 
' An instructional program for first grade through 

high school students, and 
' Health support services. 

Recruitment and Parental Involvement 

In order to be eligible for the services provided by the 
Migrant Program, the parents (guardians) of the student 
have to complete * "Certificate of Eligibility/Identification, 
Home visits to parents are made throughout the year as 
new migrant students are located and identified. When 
the Eligibility/Iuentification forms are completed, they are 
sent by the MSRTS Clerk to the Region XIll Education 
Service Center for entry into the MSRTS data bank in 
Little Rock, Arkansas, 

The Chapter 1 Migrant legislation requires that staff 
consult parents in planning, operating, and evaluating the 
program. The Migrant legislation als<^ requires a Dis- 
trictwide Parental Advisory Council (PAC), In this 
manner parents can advise the District in its planning and 
operation of the program, as well as receive up-to-date 
information and training on areas of interest-helping 
children with reading and mathematics at home, etc 
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Instructional Program 



Grades 1*6 

The insiruciional emphasis al these grade levels is .supplc- 
meniary oral/wriucn eominunication skills in coordination 
with the regular school curriculum. 

Grades 7-12 



The instructional emphasis at these grade levels is supple- 
mentary communicalion skills in eoorUinaiion \Mth ihc 
regular school curriculum. 



Program 
Description 
continued 



Health Services 

The Migrant Program provides health benefits to migrant 
students who are in need of them. The halMime Migrant 
Program Nurse screens and examines the migrant students 
wiih a focus on currently migratory students. 



This plan contains summary information from the ECIA 
Chapter 1/Chapier 1 Migrant 1990-91 Evaluation Design 
(OREPublieation 90.02). 
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Decision I Should the Chapter 1 Migrant Supplementary Reading 
Question I Instruction Component be modified? If so, how? 



EVALUATION QUESTIONS 



IN FORMA HON SOURCES 



Were ihe achievemenl objectives 
mci at 

Grades 1-6? 
• Grades 7-«? 
' Grades 9-12? 



ITBS (April) 

Tests of Achievement and 
Profcicncy (TAP) (May) 



1-2, How do the gains/achievement ITBS (April) 

scores made this year by Migrant TAP (May) 

students in grades 1-12 compare 
with the gains/achievement 
scores in 1989-90? 



1-3, What have been the long-term 
effects of participation in the 
Migrant Supplementary Reading 
Instruction Component on 
migrant students' achievement? 



Migrant Student Master File 
(ongoing) 



1 '4. How do the achievement gains 
made by Chapter 1 Migrant 
students compare with gains by 
Chapter 1 students? 



Record of Student Services 
(ROSS) (ongoing) 
Migrant File (ongoing) 
ITBS (spring) 



1-5, How Successful was the imple- 
mentation of the Supplementary 
Reading Instruction Compo- 
nent? 

What concerns/strengths 
were identified by Chapter 1 
Migrant teachers? 



Chapicr ]/Chapler 1 Migrant Teacher 
Survey (spring) 



What concerns/strengths 
were identified by Chapter 1 
Migrant staff? 



Administrative Staff interview (spring) 
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Decision I Should Chapter 1 Migrant Supplementary Reading Instruct 
Question I tion Component be modified? If so, how? 



EVALUATION QUESTIONS 

1-6. How many 1-12 students did 
Migrant teachers and tutors 
serve? 



INFORMATION SOURCES 



ROSS (ongoing) 



1-7. What percentage of migrant 

students (1-6, 7-8, 9-12) served 
by a Migrant teacher were 
served by each instructional 
method (lab, team teaching, 
special class, and other)? How 
does this compare with 1989-90? 



ROSS (ongoing) 



1-8. What number and percentage of 
migrant students received 
supplementary instruction from 
another source? 



Overlap Study (Dec) 



1-9. What is the average cost of the 
program per estimated student 
contact hour? 



ROSS (ongoing) 
Migrant Application for 
Funding (August) 



1-10. How many students were served 
by the Migrant Program by age, 
gender, grade, and evaniciiy? 



ROSS (onf jing) 



1-11. How were the elc mcntary 
Migrant instructional funds 
spent? 



Administrative Staff 
Interview (spring) 
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Decision 
Question 
2 



Should the Health Services Component be modified? 
If so, how? 



EVALUATION QUESTIONS 



INFORMA TION SOURCES 



2-1. Were the component's objectives 
met? 



2-2. What services did migrant 
students receive? 



Migrant Health Scr\'iccs 
(ongoing) 

Migrant Health Services 

Form (ongoing) 

Migrant Student Master File 

(ongoing) 



2-3. How many migrant students (by Migrant Health Services 

grade, gender, and ethnicity) Form (ongoing) 

were served by the Migrant 
Nurse? 



2-4. How successful was the implem- 
entation of the Health Services 
Component? 

, What concern.s/strengths Administrative Siafflntcr- 

were identified by program view (spring) 

stafi'? 
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Decision | Should the Parental Involvement Component be modified? 
Question I If so, how? 



EVALUATION QUESTIONS 

3-1. Were the component's objectives 
met? 



3-2, How many Migrant Districtwide 
PAC meetings and training 
sessions were held betw^n 
August 27, 1990 and May 31, 
1991? 



IN FORMA TION SOURCES 

PAC Records (ongoing) 
Administrative Staff 
Inteiview (spring) 

PAC Records (ongoing) 



3-3. Did more migrant parents attend pAC Records (ongoing) 

Districtwide PAC meetings 
during 1990-91 than during 
1989-90? 



3-4. How successful was the imple- 
mentation of the Parental In- 
volvement Component? 

What oonoems/strengths Administrative Staff Interview 

were identified by program (spring) 

stafl? 



Decision 
Question 
4 



Should the Migrant Student Record Transfer System 
(MSRTS) Component be modified? If so, how? 



EVALUATION QUESTIONS 



INFORMA TION SOURCES 



4-1. Were the component's objective 
met? 



MSRTS Records Review 
(ongoing) 
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TEA Report • 1990-91 School Year 



EVALUATION QUESTIONS 

What is the total number of 
eligible migrant students identi- 
fied 



IN FORMA TION SOURCES 



Regular term? 
Summer term? 



Migrant Student Master File 
(ongoing) 



How many migrant students 
participated in gifted and 
talented programs 

Regular term? 
Summer term? 



Gifted & Talented Records 
(ongoing) 



How many migrant seniors 
graduated 

Regular term? 
Summer term? 



Student Master File 
(ongoing) 

Migrant Student Master File 
(ongoing) 



How many migrant students in 
grades 2-12 (by grade) who were 
served by a Migrant teacher had 
pretest scores in 1989-% and 
posttest scores in the 1990-91 
school year? 



ITBS (spring) 
TAP (spring) 



For the students in Question 4 
what was their pretest NCE 
average by grade for 1989-90? 



TAP (spring) 
ITBS (spring) 



For the students in Question 4, 
what was their posttest NCE 
average by grade for 1990-91? 



ITBS (spring) 
TAP (spring) 



For those students in Question 
4, what was their NCE average 
gain/loss by grade for 1990-91? 



ITBS (spring) 
TAP (spring) 
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Information 
Need 



TEA Report - 1990^91 School Year 



EVALUATION QUESTIONS 



IN FORMA TION SOURCES 



& For those students in Question 
4, who were served by a Migrant 
icachcr in 1990-91 and who have 
a lest (spring) score, what was 
ihcir NCE average by grade for 
1990-91? 



ITBS (spring) 
TAP (spring) 



9. For those students in Question 
8, what was their NCE gain/loss 
by grade for 1990-91? 

10, For those students in Question 
4, who were not served by a 
Migrant teacher and who have a 
1990-91 ^"t score, what was 
their NCE gain/loss by grade for 
1990-91? 



ITBS (spring) 
TAP (spring) 



ITBS (spring) 
TAP (spring) 



11. For those students in Question 
8, what was their NCE gain/loss 
by grade for 1990-91? 

12. What is the average number of 
essential elements presented lo 
migrant students in summer 
school? 



ITBS (spring) 
TAP (spring) 



Secondary' Student Grade 
Reporting File (SSGR) 
(summer) 



13. What is the average number of 
essential elements mastered by 
secondary migrant students 
during summer school? 



SSOR (summer) 
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Information 
Need 



Needs Assessment 



EVALUATION QUESTIONS 



INFORMA TION SOURCES 



How many migrant students will 
be enrolled in each school (by 
grade) in the 1991-92 academic 
vcar? 



Migrant Sludcni Master File 
(ongoing) 



Whai is the achievement level of 
migrant students by school and 
by grade? 



What compensatory programs 
served migrant students at each 
grade for each school? How 
many migrant students were 
served by each? 



Migrant Student Master File 
(ongoing) 
ITBS (April) 
TAP (May) 

Overlap Study (December) 
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PROGRAM DESCRIPTION 

Qi^ner 2 Fonmula is authoraed throng tte Etemmti^ and 
Secondary Education Act of 1965 (ESEA)) as amended by 
P.L. 10(V297 in 1988. States earn Oiapi^ 2 funds based m 
(heir $dKK)I-age po|»ilatiOT* St^es, in turn, allocate at least 
%)% of these funds to local school districts based on enroll- 
ment 



CHAPTER 2 
FORMULA 



EVALUATION PLAN 



Contact Permi: 

Nancy Baenen 



QuQH^ 2 funds can suppon programs ^rviccs in several 
categcHies. The categcmes* 9tA AiSD {nograms in each, Bit 
stown beiow. 

At-Risk Students 

• ElenKntary amputer-assisted instruction labs-Blanton 
Wtcat lab» Read Bridge lab, and Blackshcar Writing to 
Read lab 

• Extracurricular transpcHtatkm 

• C(mprehensive Competencies Program at Johnston High 
School 

• Rainbow Kits 

Staff Development 

• Spanish Academy 

• Middle school advisory cuiriculum 

Innovative Projects 

• Pre-K sun>iements 

• Technology ediKraticMi 

• Multicultural/special purpose buses 

Personal Exceitence 

• Academic Decathlcm 

Instructional Materials 

• Libmy restHirces 

• Private schools 



In 1990-9K the Austin Independent School District (AISD) 
will receive about $575,000 through Chai^ 2 (plus funds 
rolled forward from 1989-90). Funds alkx:i^ per ccmpo- 
nent vary cmsider^ly, fnmi over SIOO^CXX) for extracurricu- 
lar tran^sortatkm to abcM $5XXX) for middle schod training. 
In addition to the componoits listed dxrve» some funds arc 
used fcK* evaluation and mffiiagementctfChai^ 2. Evalua- 
ticKi inform^k^ will be provicfed through the half*time 
Chapter 2 research analyst. 
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ACADEMIC DECATHLON: Is this program contributing to 
academic excellence at the secondary level in AISD? Should the 
program be continued in its present form? 



Educational 
Issue 
I 



EVALUATION QUESTIONS 

1-1. What is ihc Academic Decathlon? 
Whfch schools were active in the 
program? How many staff were 
involved? How many students 
were recruited , {Hactic^ and 
participated? What was student 
representation in terms of ^nic- 
ity, sex, and gr^? What was the 
cost per student? 



INFORMATION SOURCES 

• Program Reccmls (February) 

• Survey Program Coaches 



1 -2, Did the program function 

smoothly? Were recruiunent 
efTorts successful? 



Survey Program Coaches 
Int^ew Comlinator 
Disthctwide Staff Surveys 
(Febffuaiy) 



1 -3. Was the Decathlon effective in 
promoting academic excellence? 



Districtwide Surveys 
Interview Program 
Coo:dinator 
Medals Won 
(February, April) 
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ELEMENTARY COMPUTER LABS: Are these labs contribut- 
ing to the educational experience and academic perfonnance of 
at-risk students at Blanton, Read, and Blackst^ar? Do these labs 
represent viable models for other elementary schools in AISD? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



2A. What was t)M^ nature of each lab? 
What subject areas were covered? 
What did Chapter 2 immde for tl^ 
labs? At whai cost (overall and 
per student)? 



Survey. Interview of Princi- 
pal/Akte (December) 
Grants Acfaninistrator Reccmls 
(May) 



2-2, What were tl-c dutks of the aides? 
When was senrke fira provukd 
to students in e^ lab? Howw^ 
less(Hi$ in the labs cocsxiinated 
with those of the classroo-n' How 
often were students tat^ht in the 
labs? How long weie ses$i(Mis? 



Survey/Interview of Principal/ 
Aide (December) 



2-3. Which stmtents went to the labs? 

How many were served per grade? 
By ethnicity? 



Survey/Interview of Principal/ 

Aide (December) 

Rosters 

GENESYS (April, June) 



2-4, Were the labs effective in improv- 
ing students' academic perfor- 
mance in the classroom? 



Districtwide Staff Surveys 
Staff Interview (April) 



2-5, Were }hc labs effective in imjMov- 
ing students* achievement scores 
beyond what mu\d be {^dieted 
for them? 



GENESYS, ROSE 
(June) 
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Educational I COMPREHENSI\^ COMPETENCIES PROGRAM (CCP) AT 
Issue I JOHNSTON: Is this lab contributing to the acackmic perfor- 

w^hmJ mance of high-risk students at Johnston? Is it reducing the 
likelihood that participants will drop out? Does the lab represent 
a viable model for other AISD secondary schools? 

EVALUATION QUESTIONS INFORMATION SOURCES 

3-L Whai docs the JohnsiOT CcMiiputer • Staff Inteivjcw (November) 

LabiTOvkte? W)w types of 
students are eligible? How kxig 
are students geneially served? 
What did Ch^Hcr 2 fund? At what 
cost (per student)? 



3-2. What arc the duties of the Manage- • Staff Interview (Novcmbo') 

ment InfcMination Specialist (MIS) 
and teacher? How (to duties relate 
to dropout prevention? How is the 
coursewmk in the lab coordinated 
with other classes? 



3-3. How were stuc^ts selected for the 
lab? In 1990-91, how many 
enrolled overall? How many 
enrolled by the end of the Hrst six 
weeks of each semester? How 
many enrolled thereafter? How 
many students left the lab during 
each semester? 



• Staff Interview (November) 

• Program Reccmis 

• Student Grade Report (SGR) 
File 

• GENESYS 
(Febniaiy and June) 



3-4, What were the charK:teristics of • GENESYS 

students enrolled by the end of the (February and June) 

first six weeks of each seme^er? 
Of all students? 

• Sex 

• Ethnicity 

• Age 

• LEP 
Chtypoutrisk 

• PrcgnatKy status 

• Grade 

• Other? 
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Educational 

Issues 
Continued 



EVALUATION QUESTIONS INFORMATION SOURCES 

How many stuitents enrolied in the • Drc^xxit File (June) 

lab in 199(V91 dropped out by the • GENESYS (June) 

end the fifth six weeks of 

1990-91? How many students 

enrolled in CCP in 1989-90 were 

still in school as of the fifth six 

weeks erf 1990-91? 



3-6. How many spring, 1990 and fall, • Dropout File 

1990 CCP students dn^^jed out by (March) 
the end of the semeaa^ of service 
compared lo what was {^dieted 
for these groups? 



3-7. Does the CCP Lab improve • GENESYS 

students': (February) 

Credits earned 

Grede point average 

Attendance 

Disciplii^ referrals? 
What changes occtured fw these 
variables the scmeacrs before, 
during, and after CCP 
panicipaiion ? 



3-8. Did students pcrfonn well in the • Program Records 

lab courses? How many had (February) 
passing grades but excessive 
absences (NG's)? 



3-9. Was the lab viewed as effective in 
decreasing the risk of drof^ing out 
by students and staff? 



Staff Interviews 
Suident Survey/Interview 
Distrkrtwide Staff Surveys 
(January, April) 



DS 
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Educational 
Issue 
4 



EXTRACURRICULAR TRANSPORTATION: To what extent 
does this service enable students to participate in extracurricular 
activities? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



A'\. How many bus runs paid for 
with Chapter 2 funds? Hownumy 
individual sUKlenis rode the bus? 
What was the cost per sUKleni? 



Program Rec(^ 
(February, June) 
IHstriawide Suiff Surveys 
(April) 



4-2. Did the [^Dvision of extracurricu' 
lar tran$ponati(^ give reassigned 
students an opportunity to partici- 
pate in extracuiricular activities? 



Districtwidc StaiT Surveys 
(April) 

Student Survey 
(December) 



4-3. How often did reassigned students 
use this transportation? Fc^what 
activities werc the buses used? 



Districtwidc Staff Surveys 
(April) 

Student Survey 
(Decemtjcr) 
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Educational 
Issue 
5 



LIBRARY RESOURCES: Were the materials found to be use- 
ful? Are more needed? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



5-1. What types of materials were 

purchased with ChsqHer 2 funds? 
How wene funds alkx^ated to 
schools? Within schools? 



Staff Interview 
(April) 



5-2. How many stud^ts w^ impacted 
by the maicri^ils by giade spml 
At what cost (overall and per 
sUKfent)? 



Grants Administrator Records 
Student Recc^ Counts 
(April) 



5-3. Were materials viewed as 

effective in im]:TOving students' 
and staffs' access to reference 
materials? 



• Districtwide Staff Surveys 
(April) 



90.07 



Educational 
Issue 
6 



MIDDLE SCHOOLS ADVISORY CURRICULUM: Was the 
curriculum provided helpful in implementing middle school 
advisory/homerooms programs? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



6- 1 What currkulum was devetqx;d? 
Whai topics were covered? 



• Staff Interview (May) 



6-2. Who used the curriculum? 



StalT Interview/Survey 
Program ReccMds (May) 



6-3. Was curriculum viewed as useful 
and effective? Should AISD 
continue to {xxxliice curriculum for 
the homenxMn/advi«>ry program? 



Staff IniCTview/Survcy 
Districtwide Staff Surveys 
(April) 



> / 
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Educational 
Issue 
7 



PRE-K SUPPLEMENTS: Was pre-K helpful to 
those served? Was the fiill-day program more 
effective than a half-day program would have 
been? Should the supplemental half day continue 
to be provided? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



1' 1 . Which schools received sur>1c- 
mental half-day pre-K thrcMigh 
Chflpicr2? Were units k>w* 
income, bilingual* or English-as-a- 
Second Language? 



Staff Interview 
(September) 



7-2. How many students were ^rved? 
What were their characteristics 
(e.g., eihnicity, sex, LEP)? 



Program Rcconls 
(October and May) 



7-3. What were students ' gains on the 
Peabody Pictiue Vocabulary Test 
(PPVT-R) from fall (pre) to sjMing 
(post)? Was the extra half day of 
ine-K effective' in increasing 
vocabulary gains beyond those 
seen for half day students? How 
did gains compare to previous 
years? To AISD full-day pre-K 
students overall? 



PPVT-R (June) 



7-4. Was tl^ extra half day of jw-K 

viewed as helpful and effective by 
stafT? 



Districtwidc Staff Surveys 
(April) 
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PRIVATE SCHOOLS: Were funds viewed as helpful by 
participating campuses? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



8- 1 , How were i»i vale schools mHifled 
of their eligibility (i^ Chapter 2 
funds? How many were notified? 
How many elected to partkipate? 



• Grants Administrata- 
Interview (Felaiiary) 



8-2. What was the ChqHer 2 allocation 
fOT private schools? How many 
students were impacted by grade? 
What was the cost per student 
impacted? 



Private School Survey 
Grants Administrator ReccHxls 
(March) 



8-3. How wett Chapter 2 funds 

utilbs^d? How did imvate schools 
rate the effectiva^s o( the 
materials* equipment, m library 
r^ources jnirchased with 
Chapter 2 funds? 



Private School Survey 
(March) 
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Educational 
Issue 
9 



RAINBOW KITS: Were the Rainbow Kits 
effective in helping at-risk students by increasing 
parent involvement in their education? 



EVALUATION QUESTIONS 

9-1. Whai arc Rainbow Kils? What 
was the Chapter 2 allocation to 
Rainbow Kits? How many 
indents were impacted? By 
gfKle? How many schools 
participated? What was the cost 
per student impacted? 



INFORMATION SOURCES 

• Grants Administrator R^:(Mxis 
(December) 



9-2. How were Rainbow Kits used? 

How was the material coordinated 
with classroom curriculum and 
^vities? How were kits distrib- 
uted? What follow-up was done 
on use by families? 



Grants Administrator 
Intenriew (March) 
Dutrictwide Staff Surveys 
School Of Cenu^al QxMdinaux 
Interviews (Apil) 



9-3, How effective were Rainbow Kits 
in increasing parent involvement? 
How many parents completed 
activities? How many activities 
did they complete? 



• Grants Administrator 
Interview (March) 

• Di^ctwide Staff Surveys, 
Interviews or Parent Survey 
(April) 
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MULTICULTURAL/SPECIAL PURPOSE BUSES: Did these 
buses improve multicultural awareness and parent involvement? 
Did service improve the educational experiences of high-risk 
students? 



INFORMATION NEEDS 



INFORMATION SOURCES 



10-1, How were the multiculiural/ 
special purpose buses utili^d? 
How many students and parents 
used the services? By grade level? 



Survey of Ptogram 
Coadinmor (May) 
User Survey (June) 



10-2. Was the use of funds considered 
effective in imfnoving multi- 
cultural awareness and parent 
involvement? 



Dis&ictwide Staff Surveys 
(April) 

User Survey (May) 
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Educational 
Issue 
11 



TECHNOLOGY EDUCATION: What contribution did 
technology education make to improving the education of 
secondary students? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



How were technology funds 
utilized? How miK^h was allocated 
in Cha|Ker2ftinds? 



Staff Interview (March) 
Grants Administrator Reomls 
(June) 



1 1 -2, How many studaits and stafT 
were impacted by these funds? 
What was the cost pa- stu(tent? 



Student Recoxl Counts 
Grants Admini^iBtGr Records 
(ftbruary, June) 



1 1 -3. Were technology educatiOT funds 
seen as effective? 



StafT Interview (March) 
Districtwide Survey (April) 
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SPANISH ACADEMY: Does the provision of this training 
improve students' educational experience by enabling staff to 
deal more effectively with Spanish speakers? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



12'L What does ihc Spanish Academy 
pfX)vide? At what cost to 
Chapter!? At what cost per 
participant? 



Staff Interview 



12-2. How many courses were offered? 
How many AISD personnel 
attended a Spanish Acas^ny 
cotirse? What positions did they 
hold? To what grade levels were 
staff assigned? 



Af^UcaiicMis 
Enrollment Form 
(January and June) 
Rosters 



12-X Did participants and staff vkw the 
course as helpful? dTective? Did 
participation help ^afT communi- 
cate with Spanish-speaking 
students, parents, ccmimunity 
members, and other staff? 



Fall Course Evaluaticm 
(February) 

Staff Survey/Interview 
(May) 
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Information 
Needs 



INFORMATION QUESTIONS 



INFORMATION SOURCES 



1. 



Texas Education Agency Report — 



All (June) 



1990-91? 

• How many students were 
setvedl 

By grade? 

• Were the {HDgrams (xmsidered 
effective? 



2. Needs Assessn^tfa" 1991*92: • CH^ctwide Staff Surveys 

What are the |HioritKS for Qu^Hcr • Parent Sinvey 

2 funds? What was viewed as • Parent Advisory CchukU 

effective in 1 990-9 1 ? Meetings (March) 
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PROGRAM DESCRIPTION 



PREGNANCY, 
EDUCATION, AND 
PARENTING (PEP) 
PILOT 



EVALUATION PLAN 



Contact Person: 

Nancy Baenen 



The Texas I^slatm amhorized pilot {Hoje^ ftir teenage 
parents (and other high-risk groups) through Senate BUI 417 
(see TEC 21.114). The Austin Indq>endem School District 
(AISD) was awmkd a grant in Jamtary, 1990 to establish a 
{Hogram for middte-schod-gracte stuctotts who weie piegnant 
(^parents. T)k prograni ^tually s^ved sttKtoits in grades 8 
and 9 in 1989-90 because Rot4>^ does not serve grade 7. In 
additicRi, infimts hml to be tnider 12 mondis iMm<^ May* 
1990 for licen»ng leascms. Staff included a fuU-tin^ tei^her/ 
manager, part-time nurse, and child care woffcers. The tcHal 
amount of funding was $^^54. 

The grant was renewed for 1990-91 with a tentative 
allocation of $246^1. Some change n^^ie m^ based on 
experiences in ^^g, 1990. The grant was miemted to 
accommodme c(»itinumg students; toddkfs m now eligible 
as well as inffflts fc^ child care, A fuU-tinw |»oject manager 
and counselor are to be hired instead o( me teacher/mviager, 
nxHt child care aiites se to be hired as well (four full time 
and fcxir pait-time). Tutoring funds were cut; it is iK^ied 
students can be assigned studmt tutms though the PAL 
IHogram. This will be the First full year of :^)erati(Hi the 
grant, which runs through August 31, 199L Funher state 
funding is not expected. 

PEP supptements services provickd fw teenage parents 
tlvxHigh the Teenage Parent Program (TAPP). SUK^uscan 
participate in TAPP though the sen^sto- in which tteir child 
is bcHii, but thoe has not been a miikUc/junior hig^ schocrf 
IHX>gram to i»ovtde on-site day care aiKl suppc»t servkres for 
these stud^ts i^eviotKly. Two high schools, Johnson and 
Travis, offer child care (or stu(tents in grades 9-12. 

PEP is designed to ]m>vi(te nuiximum academic and sui^xnt 
services to stiident-parents, includii^ day care for apjmxi- 
mately 25 infants md lodcflers, occu{^ticnal informatiOT, 
counseling, tutoring, social slices (through ommunity 
agencies) and nursing. PEP hq^es to improve these parenting 
students*: 

School attendance; 

Academic skills in reading, writing, mathematics, and 
critical thinking; 

KiK?wledge $nd skills in child dcvetopment, parenting, 
home family living, nutritiim and imlividual and 
family health; 

* Health through mir»ng interveniicHis (akHig with tl^ 
health of their infants). 
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Was PEP implemented as plamied? Were any changes made 
beneficial? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



FacQity 

11. What reiK)valion5 were made to 
the infant center? When were the 
children of student-parents first 
served? 



Program Reccmis (December) 



Service Counts: 



1 2, How were students recruited? 

Approximately how many male 
and female stuctents were eligible 
for PEP? 



Waiting Ust 
Staff Interviews 
Student Survey 
Referrals (March) 



1-3. How many students who were 
pregnant or parents enrolled in 
PEP? When? What were students 
PEIMS numbers? How many of 
those eligible declined? 



Enrollment Foth 
Referrals 
Waiting Lists 
(October, May) 



M. How many students signed up for 
and enrolled in sumn^ school? 
How H'any completed summer 
school? 



Program ReccMxJs (June, July) 



1-5. What wm the char^ueristics of 
stucfeni* parents who enndled by: 

• Sex 

• Grade 

• Age 

• Ethn^ity 

« Free-Iimch status 
« Limitcd-Engli5h-|m>nciency 
(L£P) status 

• Pregnancy status (jhic- or post- 
delivery) 

» Dropout stauis (recoveted) 
« Marital status 

• Number of Qiildren 



GENeric Evaluation SYStcm 
(GENESYS) 



Enrollment Foim 

Secmdary StiKk^it Longitudi- 
nal File (SSLF) Enrollment 
Form (July) 
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Educational 

Issue 1 
Continued 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



1-6. 



How many children were sensed 
by child care? By age (year of 
birth), ethnicity, sex, and haidi- 



Enrollment Form 
Auendance Reo^ids 
(May, July) 



capping ccmditk>n? About tKnv 
many houis per week was child 
care provided? How often did 
chiklien aoend? 



1-7. How many hours per week (cMilhe 
average) did students receive the 
following types of instructk>n? 
Wl^n dki SKh instnicticKi begin? 

• Required * Program Records 

• Vocational 

• Supplemental computer- • CAI Log 



how many hours per week? 

• Social work 

• Individual counseling 

• Peer counseling 

• Self-help groups 

• Career counseling 

• Job readiness counseling 

• Crisis counseling 

• Transportation 



assisted instruction (CAI) 

• Tutorial 

• Other 

Did students take home any 
materials? 



Tutorial Log 
(December, July) 



1-8. 



What type of suj^rt servk:es 
were provided to ^udents? About 



Program Records 
(December, July) 
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Educational 

Issue! 
Continued 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



1 -9. How mmy parents, other relatives 
in the homes, or fathos of stixtent- 
parents Csignificant others'*) were 
involved in PEP? How were they 
nvdved? How finequently? 
Nodflcation of eligibility 
Open house 
Conference with staff 
Counseling 
Social wcxk 
Training 

Directed or stnictured activities 
with students 
Take-home materials 
School tasl: forces ch commit- 
tees 
Other 



• Progmn Recodls 
(May. July) 



1-10, What training (if any) was pro- 
vided to the '^significant others" of 
student-parents? To student- 
parents outside school hours? 



Program Records 
(Agenda) (July) 



1-1 L How many sUidcnts used buses 
paid for tluxHigh the pilot for 
summer school? 



Program Roccmls 

(Jtiiy) 



Work Preparation: 

\'\Z What wcHk-related Uaining or 

career expioratkMi Ktivities were 
provided lo studoit-parents? How 
many were involved? 



Program Records 
Staff Interview 
(December. May, July) 
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Educational 

Issue 1 
Continued 



EVALUATION QUESTIONS INFORMATION SOURCES 

1-13. How many student-parents who • Enroilment 

woe 16 or over wm employed (Ocu^er. May 30, July) 

upon entry to the (TOgram? How 
many weic placed in a job through 
the im>gram (by the end of the 
semester and the end <rf the 
summer session)? How many 
were placed through the Texas 
Employment Commission (TEC)? 

Public Assistance; 

1-14. How many students were receiv- 
ing various c^munity services 
upon piogram entry? At the end 
of the year? What methods did 
stafT use to increase student ^ess 
tocomm lity resources? What 
a5 '"tance is available to these 
students thrcvjgh: 

• AFDC supplement 

• Women, Infant, and Children 
(WIC) supplement 

• Attorney General's office 

• Clinic cards 

• Food stamps? 



• Program ReccHxls 
Enrollment Rmto 
(October, May 30, July) 



1-15. How many stu<fcnis use jniblic • Enrollment Form 

health cbntcs for prenatal, postna- (Octc^, May 30) 

tal, immunizations, arxl otho^ 
reasons? 



1-16. How many children of students • Enrollment Form 

use public health clinics for w^U- (Octobo^, May 30) 

baby c^. sick-baby care, immu- 
nizations, and other reascms? 
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Educational 

Issue 1 
Conti.med 



EVALUATION QUESTIONS INFORMATION SOURCES 

Staff: 

1-17. How many staff wett invdvcd 

directly in reP by funding source 
(pilot or local funds)? How many 
PTE's (full-time equivalents) did 
staff represent? What changes in 
staffing were made compared to 
1989-90? When were pilot staff 
hired? 

• Administrates 

• Teachers (by oertificaiion, 
years of expen^ice in 
education) 

• Teacho^ aides 

• Curriculum specialists 

• Coim5eI(^ 

• Social W(M*kcrs 

• Regi^red nurses 

• Child care staff 
» Bus drivers 

• Other (specify) 

1-18. How many case managers (pro- 
vided through the pilot and AISD) 
were assigned to the ]HX>gram? 
What were their duties? What was 
the staff:student ratio? 



1-19, What training was pnwided to the 
staff (ddtcs« topics, number 
sessions, number atiemling, 
hours)? Was AAT credit 
approved? 



1-20. What was the certification fflKj • Program R6C(mls 

yean of experience of teachers • Persomel Files (February) 

working with PEP students? 



£-6 

To 



Program Records 
(February, June) 



Personnel File 



• Program Records 
(Felwary, June) 



• Training Form 
(FctHiiary, June) 
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Educational 

Issue 1 
Continued 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



CoinmuDit)^ Support: 

1-21. What businesses;/agencies/ 

organizaiions/visiling i^ysicians 
or medical staff were invcrived in 
the Ingram (number and names)? 
How? 

Medical/clinic services 
Child care services 
Tran^x»taii(H) 
Coimseling 
Case management 
DonaticHis of equiimient 
Cash donations 
AdvisOTy servkres 
Human resources (time/labor) 
Testing 
Other 



Outside Agency Log 
(January, June) 



1 -22. How many volunteer organiza- 
tions suppwicd PEP? How many 
volunteers were: 

• University sUKfcnts, 

• University faulty/staff, 

• Community nKmbers, 

• Students, 

• PiTOTtS, 

• Other? 



Outside Agency Log 
(January, June) 
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Educational 

Issue 1 
Continued 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



Services to Students: 

1 -23. Whai services were provided lo 
students? What materials, 
methods, and techntqi^s were 
used to encoura^ »:adantc 
achievement and graduation? 
How many tutorial sessicMis were 
jHOvidcd? 

1 '24. How were PEP and regular AISD 
health ^rvices coordinated? 

1-25. How were PEP and regular AISD 
genera] and vocational courses and 
services coordinated? 



Program Records 
StafT Interviews 
(May 30, July) 



Tutorial Log 
(Janiiary, July) 

Staff Interview 
(April) 

Staff Inta^iew 
(April) 
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How effective was PEP? Should the program continue as is or be 
modified, or discontinued? Should it be recommended for 
replication in other districts? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



2- 1 . Were the following program 
objectives met? 

• To provide support services for 
midole/junicK high school 
parenting students? 



To provide child care »rvices 
for parenting students in a 
school setting? 

To improve school attendance 
of parenting students between 
1989^90 and 1990-91? 
Compare to student-panents in 
TAPP in the same grades? 

To improve parenting students' 
acacfemic skills in i eading, 
writing, mathematics, and 
critical thinking, especially as 
rcflecicd in grades and credits? 

To improve parenting students' 
knowledge and skills in child 
devek^ment^ panting, tuMne 
and family living, nutriticm, 
and family health? 

To improve parenting students' 
health, as well as their babies* 
health, through nursing 
interventions? 



Enrollmmt FcHHis 
Staff Interviews 
Pn^ram recwls 
Outside Agency Log 
(October, May, July) 

Program Rec(»xis 
Enrollment Fcmns 
(Fehruaiy, July) 

GENESYS (July) 



Student Report Cards 
Staff Interviews 
Student Survey (May) 
GENESYS 
(January, May) 

Student Survey (May) 
Student Report Cards 
(January, May) 



Enrollmmt Form 

Program Records on Nursing 

(May, July) 



To provi(k employability and 
occupatk)na] infonnatkMi {(x 
middle school^unk^ high 
parenting students? 



Program Records 

(see EQ10,1.8,M2,M3) 

(May) 



• To provide required aaff 
devek^>ment for j»x)ject 
personnel? 



Program Recmis 
(see EQ 1-19) 

0^) 
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Educational 

Issue 2 
Continued 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



To coordinate with local 
agciKies oflering programs for 
pregnant and parenting 
students? 



To provide an end-of-year 
evaluation report? 



Program Reccmls 
(Advisc^y ccxnmittee list, 
meeting agenda, attendance 

(secEQl-2Ul-22) 
(May, July) 

Evaluation Report 
(August, November) 



2-2. How many student-parents left 
PEP after enrolling? Why? 

• Services declined 

• Withdrawal fnm AIS D 

• No longer eligible 

• Successfully exited 

• I>ropped out of school 

• Entered GED Program 



Enrollment Form 
SSLF 

(February, June) 



2-3. Was PEP able to keep sujdenis in 
school? What was the dropout 
rate for students while in the 
program? Did any Audents leave 
the pikH but later return? Does the 
PEP dn^xxit rale c^xnp^ 
favorrf>ly to that fw TAPP for 
students in the san^ grade? 



SSLF 
GENESYS 
(February, July) 



2-4. Were any stmtents suspended or 
expelled while in the program? 
How does this rate comf^re to 
TAPP? 



Program Records 

OffKre of Student Affairs File 

(JufK) 



2-5, 



Did my ^dents beccmie pregnant 
while parlJCfpating in tl^ pilot? 



Enrollment Form 
Staff Interview (May) 
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Educational 

Issue 2 
Continued 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



2-6, How many ninth gracters enrolled 
had passed the TEAMS? Were 
siiKfents who failed mc m more 
sections assigned to courses, 
tutCHing, or other activities which 
might improve these skills? Was 
any preparation for TAAS 
provide? How did those tested 
on TAAS perform? Compared to 
AISD overall? 



TEAMS FUc 
TAAS File 
Program Records 
StaiT Interviews 
(January) 



2-7. Did students make satisfactory 
academic progiiess? How many 
were {HXMnoted i^aced in the 
next grade? Did any gradiate or 
obtain a GED? How many 
courses did they take? How many 
courses did they pass and fail? 
How many cnxlits did students 
earn (half credits fw grades 9-12)? 
What was their grade point 
average? Compared to 1989-90? 
Compared to TAPP? How many 
summer school credits (if avail- 
able) were earned? 



GENESYS 
(July) 



2-8. What was the enrollment status of 
students 12 weeks after leaving the 
program? 



Program ReccKxls 
Enrollment Fwm 
SSLF 

(September, Ongcnng) 



2-9. Did the program help students 

become more productive citizens? 



Data from other EQ*s: 
Dropout (SSLF), 
Atlcndamrc (ATND), 
Career preparation* 
Grades (SSGR), 
Studrat Stu^^y/lnt^iew, 
Staff Interview 
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Educational 

Issue 2 
Continued 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



2-10. 



What were the start-up and on- 
going costs of tt^ pro^t in ternis 
of time, facilities, training, and 
evaluaticMi? 



Progrvn Rec«ds 
FiniBK:e Recwds 
Staff Interviews 
(June) 



2-11. What pn*lenis weie enccHintcrwl • Stafflntcrvicws 

with the program? Whatrecom- (July) 
mendatiOTS were made for 
improven^nt? 



2-12. Could and should the (TOgram be « All sources 

replic^ed in other sites? What (June) 
were the imique charsKteristics of 
the district, stud^ts, ami re- 
sources? Can the program 
continue in AISD with kx^al 
funding? in what fc^? 



2-13. Was the program considered • All sources 

effective? What program aspects (June) 
seemed most effective? Were 
stafllng and other changes 
considered beneficial? 
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INFORMATION NEEDS 

1. How many suxtents in AISD are 
pregnant or student-parents? 
By grade Icvd? 

2. What programs have been 
successful nationally ni reducing 
pregnancy rates? 

3. What programs have been 
successful nationally in helping 
stucfent-paients succeed in school 
and graduate? 



INFORMATION SOURCES 

Travis CcHWity Health 
Department 

• High School Student Survey 
(March) 

• Literature Review 

• Program Staff 
(May) 

Litmture Review 

• Program Staff 
(May) 



4. Wliat were the reading and • ITBS 

mathematics NCE sanies of PEP • TAP 

students te^ both in 1989-90 « NCE Conversion Chart 

and 199(V91 with cither the TAP (July) 
or ITBS (same test both years)? 
How did these scores compare to 
those of same-gra(te students in 
TAPPai Sl John's? 
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TITLE VII 



EVALUATION PLAN 



CfNitact Persons: 

David Wilkinson 
Roxane Smyer 



PROGRAM DESCRIPTION 

AISD has received a new three-year grant for the Title VII 
I^ograni. The progrun is directed U limit^-&iglish- 
(nx>ficiem (LEP) stwtoHs si three high Ktool campuses, 
Au^, Lanier, and Reagn. Inoeasingnumbmof immi- 
grmt5 are etm^tng at these three schods* All language 
backgnxmds are eligible for 'Jie pn^rmi, but Spanish is the 
primary langua^ spcAen by most tmmigrsit students. 
Students targ^ed for die |vx)gTam, in addition to being LEP 
are also newcofmrs to tl^ United States. For the puipc^es of 
the int>gram, a newomier is defli^ as a stuctent who has 
been in the United States fw a year or less. The newcmier 
students typically have little or intemq>ted schooling in their 
countries of cmgin and are« in some cases, illitf^ate. 

Title VII )mpes to improve tl^ English Imguage jHoficiency 
aiKl achievement skills of tlwse targeted i^wama^ Spanish- 
^)ea}dng, LEP students. Hie program will imvide a shel- 
tercd envinmnient for tli^se stiKtents. Gass sizes will be 
small-ai^nx)ximately* 10-12 students. The stucknts will 
receive four hours of intensve English infraction each day 
(to inclu(te likening, reading, writing, grammar, and vocabu- 
lary). In additicHi to the English classes, students are enrolled 
in a physical educatkxi cla^ and two hours of content classes 
of native language in^ruction or a combin^ion of both. 
There is one teacher and one teacl^r aide at each camfnis. 
The program stucfents will be put into regular ESL classes at 
the end of the year. Approximately 15 students will be 
served by the program. 
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Should the Title VII Program be continued as it is, 
modified, or discontinued? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



1-1. What were the characieristics of 
the Title VII students in tenns o(: 

Number of students served? 

Length of time in the 

United States? 

Countries of wigin? 

Urban ch- rural filing? 

Amount of schooling in their 

home country? 
• Percentage overage for grade? 



• Ptx^ram Recotds 

Teacher Intake Interviews 



1 -2. What were the raw score English 
proficiency gains, on the average, 
for Title VII students? 



English Language Assessment 
Battery (LAB) 



1-3. What was the grade point average 
for program students? What was 
the grade point average for 
program students in classes other 
than ESL classes? What was the 
average number of credits earned 
by program students? 



Student Grade Report File 
(SGR) 

Office of Research aiKl 
Evaluation Generic Research 
Evaluation System 
(GEMESYS) 



1 -4. What did Title VII students think 
of the program*^ Did the students 
feel welcome tn their schools? 
Were jKOgram students more 
confident about staying in school 
as a result of Title VII7 Did the 
aide help the students? How did 
the aide interact? 



Student Survey (March) 



1-5. How many tethers attended the 
workslKTps sponswed by the Title 
VII program? Whtt did teachers 
think of these workshops? 



Attendance Recwds 
Evaluation ikxms 
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EVALUATION QUESTIONS 



INFORMATION SOURCES 



1-6. To what extern did aides use Title 
VII funds availabte to aumd 
college? What courses did 
te^:her$ take? 



• Budget Expenditures 
Staff Interviews 



1-7. 



How many Title VII parents 
att^Kied the parenting workshops 
sponsored by tl^ Htle VII 
program? What was their opinion 
of each workshop? 



Staff Interviews 
Attemlance Recmds 
Workshop Evaluation Forms 



1 -8. What concems/strengths about the 
implementation of the (rogram 
were testified by: 

Program administrators? 

LM)gram teacl^rs? 

Program teacher aides? 



Staff Intm'iews 



1-9, What was the 199a91 budga for 
Title VII? What did the funds 
provide? What was the cost per 
student? 



• Tide VII Budget 

• Program Rcccmls 



I '10. How effective was the aide as a 
part of the Title VII program? 



' Administrator Interv^iews 
• Project Records 



Ml. How did Title Vllstudcaits 

perfcmn on academic measures of 
stK^cess company to ^milar LEP 
students? 



GENESYS 
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SCHOOL-COMMUNITY 
GUIDANCE CENTER 



EVALUATION PLAN 



Contact Person: 

Lydia Williams-Robertson 



PROGRAM DESCRIPTION 

This evalu^ion {rfw is a {mliminary om becaise t)» 1990-91 
grsni ai^ltcaiion is cuirently being processed by the Texas 
Educatk^ Agency, Tte plan will be finalized wl^ the 
a{^Ucatim isiq^roved. 

The Schod-Community Guidance Center (SCGQ ;»x>vides 
suppon scrv^kes lot stt^lents attmding the alternative 
Learning Center (ALQ and Gaidner-Betts House (GBH) 
becmise oS delinqticnt bdiavic^ or contact with the juvenile 
justice system. Ttffte project ^)ecialists save as liaisons 
bet^wn AISD, stuctents, and c(Mninunity agencbs. Two 
provide counseling sid tut(»ing ^rvices at the ALC; one 
]»x)vide$ edtK::atimal ^rvices at GBH. 

In 1990-91 the ALC will be implementing a behaviOT change 
ITOgram indiuiing: 

• A modified referral imcess, (Hoviding hcKne school with 
alternatives to removal of those students OHnmitting non - 
dangerous (Senses, 

A level system in which a student's length of stay at the 
ALC will be ocHitingc^t upm moling a specific set of 
behavioral criteria for a q>ecific mmiber of days. 

* Joint (mgramming with the Travis County Juvenile 
Court, to provide services fcH* those students who can be 
served neitto' in a regular, ikh' in an alternative setting. 

This evaluatim will study shcnt- and long*term effects of the 
program. In additkm to loddng at the characteristics oi the 
students, the evaluaticHi will examine their attendaiKe rates, 
school performance, recidivism, c(Kitacts with juvenile justice 
authOTties, f(dIow-up contacts, and drupuui rales, as well as 
the new behavic^ omponents. Evaluatim resources 
include one half-time evaluation associate funded by the 
grant, with supervision {Hovided by the Systemwide Evalua- 
tion evaluatt^. 
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Decision 
Question 
1 



Should changes be made in the way students are identified or 
placed in the SCGC program? 



Dale needted: June, 1991 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



Dl-L How fTi^ny stiK^ts were assigned 
to ihe if \ * at the ALC? How 
manyv^ ;* ^ . / cdatGBH? 



Student Refcnral Forms 

GBHLogs 

Staff Interviews 



D 1 -2, What woe the characteristics of 
SCGC iiudei.ts: 
By ,;rade? 
Bye:hnicit^? 
By age? 
By gender? 
By offense 
By income status? 



Student Referral Logs 
GBHLogs 



Dl-3* How many students had previous 
referrals to the ALC? 



Student Referral Forms 
GBHLogs 



DM. From which schools were students 
referred to the ALC? How many 
students were referred from each 
school? 



Student Referral Forms 



Dl -5. Fw what offenses were suidents 
referred to the SCGC? How do 
offenses this year compare to the 
previous year? 



• Student Referral Forms 

• GBH Logs 



Dl -6. How many ALC students were 

referred, at least in part, because of 
ccHitact with juvenile justice 
system aulhwities? 



Student Referral Fwms 



Dl -7. What was the cost of the program? 



BiKlget Records 
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Decision 
Question 
2 



How can the School-Community Guidance Center's focus on 
improving problem behaviors x enhanced? 



Date neeikd: June, 1991 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



D2 1 . What services did ihe SCGC 
program slaff iwiovide? 



Staff Inlttvicws 
Activity Logs 



D2-2. What training did the jxogram 

staff receive? What r^aHnmenda- 
lions did the staff offer for 
improvement of the SCGC? 



Staff Interviews 
Activity Logs 



D2-3. What behavioral iTOgrams WOT • Program Rcccmds 

implemented at the ALC? How • Attitude Scale 

effective were they in imj»t;ving • Staff Interviews 

stuctent acacfemic perfcmnance? 
Decreasing disniptivc behavior? 
Decreasing ccmtact with the 
juvenile justice system? 



D2^. What savices were provided for • Staff Interviews 

summer school students? How • Summo* School Activity Logs 

many students were served? 



D2'5. Which agencies outside AISD • Activity Logs 

were used as resources for • Staff Interviews 

students who needed further • Student Referral Forms 

assistance? How many students 
wcjie referred? 

D2-6, How many stu(fents had further • GBHLogs 

contact with GBH after enrollment 
in the ALC? 

D2-7. How many ALC studails dropped • Di^ct Files 

out <rf school during the semester • AISD's CHopout Report 

of enrollment? How {k)es this 
figiuie cmipffiie to last ^s ? 
How does it compare to AISD's 
overall dropout rate? 
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Decision 
Question 2 
Continued 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



D2-8. When students exited from the 
ALC, how many: 

a) Relumed to campus? 

b) Transferred to another 
aliemativc program? 

c) Graduated? 

d) Were expelled? 

e) Moved out of AISD? 

f) Were cmimittcd to another 
institutkm? 

g) I>t^^)ed out of school? 

h) Remained at the ALC? 



Student Referral Forms 
Pinoject Specialist FoUow-up 



What arc student opinions ^ut 
the programs? Employee 
opinions? 



Stu(tent Survey 
Employee Survey 
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Decision I How effective are AISD's anJ SCGC's follow-up services in 
Question I helping students readjust to their home campuses? (Students 
^ ■ enroUed spring, 1990 and fall, 1990). 

Dale needed: June, 1991 
EVALUATION QUESTIONS INFORMATION SOURCES 

D3-1. What follow-up scrvkcs were • Staff Interview 

I»t)vided by SCGC stafl? 3yihc • District Survey 

home schools? 



D3-2. Twelve weeks after exiting frwn • Follow-up Forms 

the ALC in spring and fall. 1990 



how mar<y students were: 


a) 


At their hone schools? 


b) 


Enrolled in ancHlKr program? 


c) 


ExpeUed? 


d) 


Moved outof AISD? 


e) 


Committed to another 




institution? 


f) 


Dn^^ied out of school? 


g) 


Returned to ALC? 



D3-3. Of the students still in school 12 • Attendance File 

weeks after exiting from the ALC, 
was their attendance better, worse, 
or unchanged? 



D3-4. What was the school perfOTTiance 
of all enrolled siu<tents befcm, 
during, and after enrolbrent in the 
ALC? (Spring and fall, 1989) 



• GENeric Evaluation SYStem 
(GENESYS) 



D3-5. Of the students still in school 12 
weeks after exiting frrni the ALC, 
was their school perfonnance 
better, wcme, or unchanged? 



• GENeric Evaluation SYStem 
(GENESYS) 



D3-6. What was the status (in school or • Secc^ui^ Studoit 

dropout) ^ the end of the 1990-91 Umgitudinal File 

school year o( s&Kknts who weie 
enrolted m, the ALC any semester 
since ^ng, 1986? 
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PROJECT GRAD 
(Grant Research About 
Dropouts) 



EVALUATION PLAN 



Contact PerMMis: 

Linda Frazer 
Bridget Stewart 



PROGRAM DESCRIPTION 



In 1988 federal funds were c^tain^ through the School 
Dropout Demonstration Assistance Program to augment 
the Distria*s dropout prevention efforts through the use 
of dropout intervention specialists and through an 
enhanced evaluation capability to improve the klentifica- 
tion of at-risk students and to evaluate a variety of drop- 
out pi^vention programs. The Sdiool Dropout Demon- 
stration Assistance Program began operating in 1988-89 
as Project GRAD (Grant Research About Dropouts), and 
is now in its third year. The program has three goals: 

To provide AISD schools with an increased capacity 
to keep students in school piloting the use of 
dropout intervention specialists, Tbe specialists will 
work with a targeted population of at-risk students by 
providing academic and persona] counseling assis- 
tance. Currently, AISD has at-risk coordinators at 
each campus who identify and work with at-risk 
students. The specialists are additional personnel 
who will provide more intensive assistance to stu- 
dents. 

To examine and improve the procedures for identify- 
ing at-risk students and using the available informa- 
tion to make appropriare intervention d^ion^ with 
the students. 

To enhance both the understanding of the effective- 
ness of several of the District's ongoing programs and 
our capacity to conduct evaluations of siniilar pro- 
grams in the future. 

While a variety of questions is included in this plan, ib^ 
evaluation of Project GRAD for 199(V91 will focus on 
three areas: 

The effectiveness of the efforts of the dropout inter- 
vention specialists, 

Improving the identification of at-risk students with 
an emphasis on better information reporting leading 
to better intervention strategies, and 
Learning about the effectiveness of various dropout 
intervention programs. 
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Program 
Descri^ion 
Continued 



The secondaiy programs and projects lo be examined are: 

Academic Incentive Program (AIP) 
Alternative Learning Center (iSehavioral) 
Alternative Learning Center (Overage) 
Block Project 

Communities in Schools (CIS) 
Coordinated Vocational Academic Educatioo (CVAE) 
Evening SdKX>l 

Hispanic Student Scholarship Initiative (HSSl) 
Interventk>n Specialists 
Mentor 

Peer and Assistance Leadership (PAL) 
Practical, Efiectivc, impropriate Knowledge (PEAK) 
Project Touch 
Renaissance 
Robbins 

Twn Parents Center 
Transitional Academic Program (TAP) 
Work Incentive Program (WIN) 
Zenith Diploma 
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Education 
Issue 
1 



Should the Dropout Intervention Specialists component of 
Project GRAD be continued as presently implemented, be 
modified, or be discontinued? Should local or external funds 
be sought to fund continuation of this component? 



Dates needed: January, 1991 and August, 1991 



EVALUA TION QUESTIONS 



INFORMA TION SOURCES 



1-1. Did ihe dropout rale decline as a 
resuli of ihe efforts of the 
inicrvcnnon specialists? 



• Project Records 

• Six Weeks Dropout Files 

• Staff Interviews 



1-2. Were the intervention specialists 
successful in getting dropouts to 
return to school? 



Project Records 

Six Weeks Dropout Files 



1-3. What activities contributed to 
the success of the intervention 
specialists? 



Project Records 
Staff Interviews 
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Should the At-Risk Identificatio component of Project GRAD 
be continued as presently implemented, be modified, or be 
discontinued? Should local or external funds be sought to 
fund continuation of this component? 



Dates needed: January, 1991 and August, 1991 



EVAL UA TION QUESTIONS 



INFORMATION SOURCES 



2-1. Arc we identifying the students 
who are really at risk? If not, 
how can we better identify them? 

2-2. Which of the State criteria for 
being at risk, and m what 
combination, are most prediaive 
of dropping out in AISD? 



Longitudinal Dropout File 
At-Risk File 

Home/School Services File 

Longituc^'nal Dropout File 
At'Risk File 



2-3. What other factors predict being 
at-risk for dropping out? 



Dropout File 
District Data Files 



2-4, Are the students effectively 

matched with available dropout 
prevention programs? 



Student Survey 
Program Reo^rds 
Student Master File (SMF) 
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Should the dropout prevention programs and projects in 
AISD be continued as presently implemented, be modified, 
or be discontinued? Should additional local or external funds 
be sought? 



Dates needed: January, 1991 and August, 1991 



EVALUA TION QUESTIONS 



INFORMA TION SOURCES 



3-1. What were the characteristics (i.e. 
grade, ethnicity, sex, achievement, 
attendance, discipline rates, and 
grades/credits,) of the students 
served by the dropout prevention 
and intervention programs? 



GENESYS 



3-2. What were the 1989-90 dropout 
rates for participants in dropout 
prevention programs? 



GENESYS 
Dropout Files 
Program Rc^rds 
SMF 



3-3. Which dropout prevention 

programs arc effective? Which 
are ineffective? 



GENESYS 
Staff Interviews 
Program Records 
SMF 



3-4. Which schools are the most 

effective in lowering their dropt)ut 
rate? Why? 



GENESYS 
Staff Interviews 
Program Rt^rds 
SMF 
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DRUG-FREE 
SCHOOLS 



EVALUATION PLAN 



Contact Persons: 

Roxane Smyer 
David Wilkinson 



PROGRAM DESCRIPTION 

This evaluation {dw is preliminary becaise the 199CV91 grant 
af^ltcalim is now being processed by the Texas Education 
Agency. Tt^ plan will be finalized ^f«4ien the ^)piicati(^ is 
iy^>roved. ITiis will be the fourth ytai dial AISD has 
received diese grant monies. The grant provides a full-time 
evaluatim associate. 

AISD receives fe<teral funds under tt^ terms of the I^g-Frce 
Schools and Communities (DFSC) Act of 1986 (PX. 99-570) 
fOT the purpose of ^iiq^ementii^ District efTcms to eliminate 
atHisec^dnigsc»'alcc^6om school campuses. AISD*s 
effOTts fw drug skI alorfiol ionise pevottim sre cocHtlinated 
through the Ptevention ami Remedi^k^ in Drug Education 
(PRIDE) program. Oth^DistrktdTofts replaced within 
this broad imilnella. PRIDE consists of ctirrictilum materials, 
presentation* and school activities aimed at drug abuse 
fTOvention. Funds ^ also used fc^* siqTpcm groupSt coun- 
selor training, and constants perftmntng specialized 
funcu<»is. DFSC mmies frovicte substantial funding for two 
special ;»ograms, I^r A&si^ance Leadership (PAL) and 
Drug Abuse Resistance Edi^tion (DARE). 

Peer Assistamre Lead^ship (PAL) uses trained second- 
ary ^dents to help cMher students (teal efTectiveiy with 
problems that impede siKx:es$ in school^ imrluding drugs 
(H- alcohol. 

• Ehug AlHise Resistance Educati(Hi (DARE) is a 1 7-wcck 
edi^aticmal program that re{Hesrats a jcnnt effort by 
AISD and the Austin Police Depaitment to teach fifth 
and some sixth gr^l^ about the harmful effects of drugs 
and alcohol This year DARE has exp^vted to the 
seventh-grade level with a ten-week ciffriculum. DARE, 
taught by police oflkers, focuses on cognitive and 
behavic»al skills that oiable saidrats to resist involve- 
ment with drugs and slccrfiol. AISD cocfxlin^ion is 
IHOvided throu^ the CMftce of Student Af&irs (OS A). 

In addition, DFSC monies ftow to these AISD offkes and 
departments: tte Office Student StiRX' i Services (OSSS), 
Elementary aiKl Secmdary Educasiixi. NunmtHisAlSD 
administratcHs and staff are involved in the implenmitation of 
grant-funded activities. There is outside involvtn^nt (torn 
students and parents^ medical and health i»x^essicMials, and 
v^otis relevant community agencies, incliKbng tt^ Atistin 
Police DqMutment sid other law ^oicenient ^encies. 
Many cK those involved in om or mat ot the Dnig-Free 
Schools Piograms work on a voluntary basis. 
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Should Drug-Free School funds continue to be used in the same 
way or should use be modified? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



1-1 . Are program aciministraUKS 

satined with AISD*$ drug- and 
akohol-rclated iHX)gT3nis? What 
changes advis^le in AISD's 
efforts in 1990-91, especially in 
ihe use of DFSC funds? 



Administrator Interview 



1 '2, How effective do parents, stu- 
dents, and tethers indicate AISD 
is in fighting the problems of drug 
and alcohol abuse among stu- 
dents? 



Districtwide Parent Survey 
Distriawide Student Survey 
I^strictwide Teacher/ 
Administrator Survey 



1-3. Cmipared to other school issues, 
how do drug and alcohol use mnk 
as prcAlems in AISD? 



Districtwi(fc Teacher/ 
AdministratCM' Survey 
IMstrictwide Student Survey 



1-4, What is the incidence of drug- or 
alcohol-rclated offenses amc^g 
AISD students in 1989-90, as 
compared to {nevious years? 
What parentage of stucknts report 
knowing others who use drugs or 
akrohol? What percentage of 
students report using illegal drugs 
and alcohol ; 



Office of Student Ai " ^/^ 
(OSA) File 

Districtwide Student Survey 
Districtwide Teacher/ 
Administrate^' Survey 
Student Use Survey 



1-5. What is the nature of drug and 
alcohol use among stucknts 
nati(mally and in Texas? 



NaticHial Surveys 
Texas Surveys 
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Are the materials, training, and curriculum provided for AISD's 
drug and alcohol abuse prevention efforts adequate? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



2*1, What materials were {Hirchased for 
the Drug-Free Sctools Program; 

a) At the eteir^ntary level? 

b) At the secondary tevel? 



Budget 



2-2, What distribution methods were 
used? How many times wctc 
materials tised ai: the eJemratary 
and seccmiary levels? 

2-3. What materials are included in a 
PRIDE Tub? What did the 
teachers fuid most useful? How 
often did teachers use these 
materials in their classrooms? 



Materials Check-out Record 
Administrator IntervieNV 



• Budget 

• Teacher Interviews 



2-4. Was adequate training provided to 
familiarize teachers with materials 
and curriculum and their proper 
usage? 



• Teacher Interviews 
Districtwide Tether/ 
Administrate Suivey 



2-5, What mat^ials were purchased for 
the Central Resource Library? 
How often were they used? 
What did the Central Resource 
Library consist of? 



• Purcha^ Records 

Material Qieckout Record 



2-6, What types (rf counsels training 
were provided? 



Administrate^' Interview 



2-7. How maiy counseled were 
trained? 



Administrate Interview 



2'8< What materials were purchased for 
counselor training? 

2-9, What dkl counselors think of the 
training they ru^ived? 



• Purchase Records 



• Staff Development 
EvaluatiOT Forms 
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I HowdoesPRIDEcontributetoAISD'sgoalofDmg-FrreSchoob? 

Issue 
3 



EVALUATION QUESTIONS 



INFORMATION SOURCFS 



3-1. What U PRIDE? 



• Proicci Reccxds 

• AdministnUor Interview 



3-2. How were DFSC funds used for 
PRIDE? 



Extonal Budget 
• Administrate Inlcn 



3-3. Who was served by PRIDE, and 
how? 



HIIDE Activities Rqx)rts 



3^. How was PRIDE implemented in 
AISD? To what extent were 
parents involved? 



PRIDE Acuvitic> Reports 



3-5. Is PRIDE considered helpful? 



Distriawidc Teacher/ 
Administrate^' Survey 



3-6. Were PRIDE mal»ials and 
training adequate? 



Districtwide Teacher/ 
AdministraiOT Survey 



3-7. What materials were purchased for 
the PRIDE library? How often 
weie they used? 



Purchase Records 
Materials Check-CHit Record 



3-8. How many campus^ staged a 

pre^ntation of "Plays icx Living"? 



PRIDE Administrate^' Records 



3-9. What did participants think about 
the PRIDE conference? 



C(Mifcrcnce Evaluatkni Form 
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How does DARE contribute to AISD's goal of Drug-Free Schools? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



4-1. What is DARE? 



4-2. How were DFSC funds used for 
DARE? 

4-3, How many schools and how many 
students were served by DARE? 

4-4. Was DARE implemented as 
planned? What seemed most 
effective? What could be 
improved? 

4-5, What did staff think of DARE? 



4-6. What did susdents think of DARE? 
Did students show increased 
knowledge of drug- and alcohol- 
related issues as a result of 
DARE? 



Ptojcct Records 
Administrator Interview 

External Budget 
Program Records 

Attendance Files 
Officer Records 

InstnK:tc»' Interview 



• Districtwide Tether/ 
Administrator Survey 

• DARE Student Survey 



4-7. Are students more likely to resist 
negative peer influences after 
participation in DARE? 

4-8. What is the ccmtinuing effect of 
partkripation in the DARE 
I^ogram for those students who 
received the program in 1987-88 
and a comparistm group from the 
same atteml^Ke area who di J not 
on: 

a) Absenteeism? 

b) Achievement? 

c) Incidence of drug and 
alcohc^-mlated discipline 
crfTenses? 



• DARE Student Survey 



DARE Student Database 
Iowa Tests of Basic Skills 
(UBS) File 
OSA (Discipline) File 



4-9. Did fifth'gruie ttucknts regard 
DARE differently than seventh- 
grade students? 



DARE Student Survey 
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Key I How does PAL contribute to AISD's goal of Drug-Free Schools? 
Issue I 



EVALUATION QUESTIONS 
5-1. What is PAL? 



5-2. How were DFSC iunds utilized in 
1989-90? 



5-3. Who was served by PAL, and 
how? How many studenis were 
served for drug- or alcohol-related 
problems? 

5-4. What training do PAL studenis 
receive which is specifically 
related to drug use? How many 
stuifcnts were enrolled in PAL 
classes at each campui;? 

5-5. Do students and teachers feel that 
PAL is an effective way to prevent 
drug abuse problems? 

5-6, What is the effect of participaiion 
in the PAL jrogram (or those 
students who received the (HDgram 
in 1990-91 on: 

a) Achievcn^nt? 

b) Attendance? 

c) GradcsA>cdits? 

d) Dropping out? 

e) Retention? 



INFORMATION SOURCES 

• Administrate^' Interview 

• External Budget 

• Administrator Interview 

PAL Coordinator Rccwds 



• Administrator Interview 
Sponsor Monthly Rqx>ns 

• Ejirollment Records 



• Districtwidc Student Survey 
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How do the grant-funded components of the Office of Student 
Support Services (OSSS) contribute to AISD's goal of Drug-Free 
Schools? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



6- 1 . What service^^training were 
I»t>vided by the DFSC grani 
through OSSS? 



Budget 
• Administrator Interview 



6-2. What sciviccs were provided by 
the OSSS iniem funded through 
the DFSC grant? 



AdministratcM' Interview 
OSSS Records 



6-3, At the s:Jkx)1s served, what did 

staff thi ik about the OSSS intern? 



OSSS Evaluation Forms 



6-4 , What services did consultants 
provide? 



Administrator Interview 
OSSS Records 



6-5, What support groups functioned in 
the schools? How many students 
were served? 



OSSS Records 
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THE NATIONAL 
SCIENCE FOUNDATION 
(NSF) GRANT 
FOR THE 
SCIENCE ACADEMY 
OF AUSTIN 



EVALUATION PLAN 



Contact Person: 

Lydia Williams-Robertson 



PROGRAM DESCRIPTION 

The Austin Science and Math^natics Ccmsc^um, funded by 
a four*year g/aiu fnm the NaticHud Science Foundj«k>n 
(NSF), will bf ?niptenK^ted in AISD within the fian^work of 
an inmvaiive pbruierdiip entitled Piro^t A-f launctKui in ibe 
^>ring of 1989 by the IBM CcspcHatim and AISD. The 
CcHisortium has two basic goals: 

To impiDve the skills of teacters (K-12) in science and 
mathematics tluxMigh mem effective and comprehensive 
ai^lk::aticm oi t»:hnok)gy tools available but 
underutilized in today's classrooms, mA 
To incite studem kaming and perf(»mance in science 
concqHs through more holi^, inteitlisciplinary ap- 
im>aches to teaching and expaiul^ c^^pcHtunities to ^ply 
concepts in real wcHid settings. 

To address these goals, the project is divided into four 
COTnponents: 

• Curriculum Development: The Biological Sciences 
Curriculum Suidy (BSCS) Science For Living curricu- 
lum will be pikHed at two AISD schools and evaluated 
for use throughout ihe District as an integrated science, 
technology fmd Nalth curriculum. In additicHi, an 
interdisciplinary currKulum devel(^>ment process will be 
develc^)ed ^ pikHed in the design of two Science 
Academy courses (^Planet Earth" and Physics/Technol- 
ogy). It will incopmte coopmtive teaming strategies 
and will serve as a model io^ the development of other 
interdisciplinary courses. 

Staff Development: Beginning in the summer of 1991 , 
several training institutes are planned i(x setected 
teachers to receive training in technology and curriculum 
dcvelopn^nt: 

• Technology Institute: 

Three two-week training institutes will be bekl e^h 
summ^ to train teacl^rs to integrate techndogy in 
their classrooms. Sui^temental training will be 
prcvicted by private sector participants, and folk)w*up 
activities will take place dtiring the school year. 

• BSCS Trainirtg Institute: 

A summer teacher preparation institute will be held at 
the BSCS pilot sites for the Tirst two years to train 
participating teachers in using the BSCS Science Vor 
Living curriculum. 




River Watch Instime: 

Ten te^rheis (K-12) wiO be lecniited to attend a 
summer tnsUtute to learn river monitoring techniques 
and environmental action planning. 



Program 
Description 
continued 



Student Partkipatioa: During the 1991-92 academic 
year, Science Academy stuctents will ocHKluct classes at 
element^ 9cho(^, teaching those classes whose 
tethers have attemled oik of the simuner institutes, or 
who are using the new elementary environmental units 
developed piloted through this grant Also in 1991- 
92, students whose teachm actemied the River Watch 
Institute will fonn monitcmng teams and will cany exit 
river moniicMing ibkI enviixHunental actioi {banning 
throughout the ycm, and will communkrtfe by computer 
with students in Michigm, using tfie River Watch 
Network cuiriculum. The stiKient panicipaiion compo- 
nent will mH be included in this evaluation plan, because 
student participation will begin tuuil 1991-92. It 
will, howev^, be included in subseqi^t evalu^don 
plans. 



Private Sector Involvement: Paiticipants from the 
private sector will be extensively in' !ved in all aspcxts 
of the gram: 



Mentors ivom the private sectw will be paired with 
those tethers integrating technology in their classes 
for the fust \xxoc. 



• Sctenti^, t^nologists, and engineers from the 
private sector will teach at the summer institutes, and 
participate in follow-up activities. 

• A curriculum adviscny le^ will be fcKmed with 
repres::ntatives from local corporations. Lower 
Colorado River At^hority (LCRA), and University of 
Texas la Austin facuhy to assist the curriculum 
coordinator in the (fevek^mmtf (rf two new courses: 
*nar^ Earth" and Physics/TechiHrfogy. 
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continued as is? 



Date needed: September, 1991 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



Dl-L Which schools were selected as 
pilot sites utilizing the BSCS 
Science for Living curriculuni? 
How were they selcciwl? What 
was tt^OMnpositionof e^h in 
terms of ethnicity? Gender? 



Program Records 
AISD Files 



Dl'2. How was the Science for Living 
curriculum rated by panicipating 
teachers? 



Teacher Survey 



Dl -3, How was the curriculum develop- • Program Records 

mcnt process piloted in the design AdministraiCK Interview 

of the Tlanei Earth" and Physics/ 

Technology courses? Who 

participated in the advisory 

commiucc? 
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Decision | Should the Staff Development component be modified or con- 
Question I tinued as is? 



Dale receded: September. 1991 
EVALUATION QUESTIONS INFORMATION SOURCES 

D2- 1 , Who participated in planning the • Progmm Records 

Technology Institute? How was ' Administrator Interview 

the content of the workshc^s 
selected? What topics were 
selected? What criteria were used 
to select teachei^ to attend? 



D2 2. How many teachers attended the ' Program ReccKds 

Technology Institute? What were 
their characteristics in tems of 
gender? Ethnicity? Gr^e taught? 



D2-3, How did teachers rate the training • Teacher Survey 

they received at tl^ Technology 
Institute? Did teachers increase 
their utilization of technology in 
teaching science and mathematics 
after the training? If so, how did 
this impact their skills in teaching 
science and mathematics? 



D2-4, What criteria wcie used to select • Program Recwds 

teachm to attend the BSCS 
Training In^tute? How many 
were selected? What were their 
characteristics in terms ctf gender? 
Ethnicity? Grade Uught? 

D2-5, How did the teachers rate the • Teacher Survey 

training they received 9i ^ BSCS 
Training Institute? Of what value 
was the training? How did the 
teachers plan to integrate the 
BSCS curriculum in their 
classrooms? 
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Decision 
Question 2 
Continued 



EVALUATION QUESTIONS 

D2-6. How were teachers selected lo 
aoend the River Watch Institute? 
How many te^:}^ atlemkd? 
What were their characteristics in 
terms of gcmfcr? Ethnicity? 
Grade taught? 



INFORMATION SOURCES 

Program Records 
• Administratw Interview 



D2-7. How did participating tethers rate • Teacher Survey 

the training they r»:eived at the 
River Watch In^tute? How did 
attending the Institute impact their 
awar^ie^ of environn^ntal 
issi^? Did the tethers plan to 
continue their river monitwing 
activities throughout the year? 
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Decision I Should Private Sector Involvement be modified or continued 
Qtustion I as is? 



Date needed: S^Membcr, 1991 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



D3- 1 . How weie linkages developed 
among teachers, suuknts, 
univosity faculty, dnd private 
stcux leaders which were directed 
toward better teaching and 
learning? 



• Program Recods 

• Administrator Interview 



D3-2. How many {Kivate sector 

participants were there? From 
which companies? 



Program Records 



J-6 



ERIC 



TITLE n 
MATHEMATICS 
AND 
SCIENCE 
TEACHER TRAINING 



EVALUATION PLAN 



Contact Person: 

Paula Marable 



PROGRAM DESCRIPTION 

Elementaiy and Secondary Edi^ation Act (ESEA) Title II 
is a 12 month projea for the improvement of mathematics 
and science teadiing in grades pre-K through 12 and was 
designed to serve all elementary and secondary mathemat- 
ics and science teachers in the Austin Independent School 
District Its purpose is tiiw-fold: 

(1) To provide for teacher training for grades pre-K 
through 12, and 

(2) To develop scopes and sequences for elementary 
and secondary science, grades pre-K through 6 
and grades 7 and 9. 

All 65,090 students and 2^56 elementary and secondary 
mathematics and science teachers in the District are to be 
served. From July 1990, to June 1991, Title II funds are to 
provide: 

' Staff developfntmt workshops to acquaint teachers 
with the iatcsi developments in instructional 
techniques and materials in their field, 

' Consultants to develop sdeim scopes and se- 
quences to establish a formalized science curricu- 
lum throughout the District, 

* Funds forteadiers to attend professional conven- 
tions to provide for teacher involvement within 
their profession, 

• Materials to accompany training in new methods of 
instruaion, and 

' TuitkuVstipends for teachers to attend staff devel- 
opment workshops. 



Kl 
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Key 
Issue 
1 



1 



Did elementary and secondary teachers of mathematics and 
science receive effective training? 



Date Needed: June, 1991 



EVALUATION QUESTIONS 



IN FORMA TION SOURCES 



1-1. When and where did the sufT 
development workshops occur? 
How many were offered? How 
many teachers participate? 
How many trainers were in- 
volvwl? 

1-2. Teachers received training in 

what areas, on what topics, with 
what materials? 

1-3. How did teachers think the 
training would change their 
instructional methods? 



Administrator Interviews 
Project Records 
WorkshopRosters 



Workshop Questionnaires 



Workshop Questionnaires 



1-4. How did teachers report that 

they would put the training into 
practice? 

1-5, How many teachers attended the 
professional conventions? What 
were the evaluations of the 
conventions? 



Workshop Questionnaries 



Administrative Interviews 
Projea Records 
Convention Questionnaires 
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Did elementary and secondary mathematics and science 
teachers receive effective materials? 

Dale Needed: June, 1991 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



2-1. What materials were purchase? 



Financial Records 
Administrator Interviews 



2'Z What disulbution method was 
osol? How many times were the 
materials used? 

2-3. How often did the teachers use the 
materials in their classrooms? 

2-4. Were the materials compatible with 
the training given? 

2-5. Were the new materials effective in 
improving mathematics and science 
instruction? 



Material Check-out Records 
Administrator Interviews 



Teacher Questionnaires 



Teacher Questionnaires 



Teacher Questionnaires 
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Key 

I Was a scope and sequence developed for secondary science, 
5 I grades 7 and 9, and for elementary science, grades pre-K 
through 6? 




Dale Needed: June, 1991 



EVALUATION QUESTIONS 



IN FORMA TION SOURCES 



3-1. Wbo developed ihe scopes and 
sequences? 



Administrator Interviews 
Financial Records 



3-2, 



3-3. 



3-4. 



What are the components of the 
scopes and sequences? 

What purpose will the scopes 
and sequences serve? 

When will the scopes and 
sequences be introduced into the 
classroom and with what stu- 
dents? 



Administrative Interviews 



Administrative Interviews 



Administrative Interviews 
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Were the elementary Gifted & Talented materials effective in 
improving gifted and talented instruction? 



Dale Needed; June, 1991 



EVALVA TION QUESTIONS 

4-1. What materials were purchased? 
How were they distributed? 
How often were the materials 
used? 

4-Z How were the materials rated by 
the teachers? 

4-3. Were teachers trained on how to 
use the materials? 

4-4. Did teachers make a change in 
their teaching strategies because 
of the new materials'^ 



IN FORMA TION SOURCES 

Administrator Interviews 
Financial Records 
Material Qieck-out Records 

Teacher Questionnaires 

Administrator Interviews 
Teacher Questionnaires 



4-5. 



Were the new materials effective 
in improving gifted and talented 
instruction? 



Teacher Questionnaires 



PROGRAM DESCRIPTION 



TLTG 
PHYSICAL SCIENCE 
AND TECHNOLOGY 
PROJECT 



EVALUATION PLAN 



CfMifsct Person: 

David Wilkinson 



llie AISD TLTO Physical Science and Technology 
Project is a technology-based physical scknoe cuniculuni 
targeting students at risk of dropping out The projea's 
major objectives are: 

To decrease the dropout rate at Renins Secondary 
School, 

To inoease students' sdenoe adiievement. 
To increase students' positive attitudes towards 
science and tedinology, 

To increase teachers' use of technology-oriented 
instruction programs. 

The Texas Learning Technology Group (TLTG) Physical 
Sdenoe Program will be the central foais of the program. 
The TLTG instructional program ofiers an innovative 
approach to iiicrease students' in-depth understanding of 
physical sdenoe concepts, and increase studoits' interest 
in sdenoe. The program will be conducted at Robbins 
Secondaiy School during the 1990-91 school year. In 
1988-89, 85.8% of Rob^Aiis' student population was 
identified as 'at risk,' compared to 46.1% of AISD 
students overall. Robbins offers stwtents an alternative 
education plan that utilizes a contract system. StiKlents 
are responsible for working individually at their own pace 
to accomplish the activities necessary for each course of 
study. A typical science class at RoM>ins has 13-15 
students who are enrolled in different courses. There is an 
average of seven Physical Scieiioe stu<tents during each 
period. The individualization of U» TLTO program 
should make the curriculum more useful and Mxessible to 
the students. Studenu will be working oooperativety, 2-3 
to a computer station. 

Robbins uses a contraa system which spedfied the 
activities that must be completed in eadh unit of study. 
Documentation of TLTO implementation will be pro- 
vided by the student contracts. The TLTO teacher will 
provide a set of contracts that are correlated wfth the 
TLTO Physical SdeiKx Program and state-adopted 
textbook. In addition, andllaiy notes and recommenda- 
tions will be recorded in the teacher^ guide. These notes 
will be summarized into a handbook for distribution. 

Inservioe training will be provided for the TLTO teachers 
during the school year. In tall, 1990, the TLTO teachers 
will present a workshop to interested AISD teacbos. The 
development of enrichment activities in the program will 
be strongly addressed. This indudes the elearotiic net- 
working of H-TO learning centers. 
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How effective is a technology-based physical 
science curriculum in improving the achieve- 
ment in and attitude toward science of at-risk 
students? 

Date Needed: June, 1991 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



1-1. Did ibc project meet its objec- 
tives? 



Program Records 
Interviews with Program 
Suff 

Other Assessments as 
Ekkrw 

(April-May. 1991) 



\-Z What ^vere the educational 
activities undertaken in the 
pri ject? 



1-3. Did the program students' 

science achievement impro'/e 
over the previous year? 



Program Records 
Site visits 

Interviews with Program 
Staff 

(Apri!-May, 1991) 

Tests of Achievement and 
Proficiency (TAP) Science 
Test (April, 1991) 



1-4. Did the program students* 

science achievement differ from 
that of Robbins students in 
previous years? From the 
Distria average? 



TAP Files 
(April, 1991) 



1 -5. Were students more knowledge- 
able about technology in their 
environment after fmtidpation 
in the program? 



Technology Test 
(May, 1991) 



1 -6, Did program students evince 
better attitudes toward science 
after panicipation in the proj- 
ect? 



Student Attitude Survey 
(May, 1991) 



1-7. Did program students evince 

better attitudes toward technol- 
ogy as a means for delivering 
instruction after being in the 
project? 



Student Attitude Survey 
(May, 1991) 
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EVALUATION QUESTIONS 



INFORMATION SOURCES 



Did program siudeots take more 
and higher level science courses 
than Robbins students had in 
previous years? 

1-9, Did the dropout rate at Robbins 
decline? 



Student Grade Reporting 
(SGR) File 
(April, 1991) 



Fifth Six- Weeks Dropout 
Report 

District Rm)rds 
(May, 1991) 



1-10 Did teachers* willingn^ to 
employ technology in their 
instruction increase through 
partidpation in the project? 



Teacher Survey 
(April, 1991) 



1-1 L What factors need to be present 
to expand the program to other 
schools? 



Interviews with Program 
Staff 

(May, 1991) 
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FACULTY/STAFF 
RECRUITMENT 
PLAN 



EVALUATION PLAN 



Contact PcTMms: 

Lauren Moede 
David Wilkinson 



PROGRAM DESCRIPTION 

On August 28, 1989, the Board of Thistees a<topted 
the reoommendations of the Tri-Ethnic T^k Force 
and directed that they be incorporated into AISD 
policy. Anx)ng the reoommendations was adjust- 
ment to the Distria^ recruitment goal establisbed 
in 1981 The reoommendation reads as follows: 

Adjust AISD recruitment and promotion goals to 
reflect the State of Texas available work force in 
order to ensure that AISD continues to provide 
equal employment opportunities. 

In the Department of Personnel, this recommenda- 
tion is understood to refer to the most recent state- 
wide percentages of persons currently working in 
education in Texas. These numbers are based on d«ta 
from the Texas Education A^c/s Personnel Roster. 
Figures for 1988^ are reported in the 1989-90 
Faculty/Staff Recruitment Repon (ORE Publication 
No. 89.25). For professionals, the available work force 
in Texas (tm&i on 1988-89 statewide percentages) is: 
Black, 9.4%; Hispanic. 116%; and Other, 78.0%. 
Among administrators, 1988-89 statewide percentages 
are: Black, 8.7%; Hispanic, 14.6%; and Other, 76.7%. 



The District's progress toward these goals will be 
monitored. 
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I Is AISD meeting its affirmative faculty/staff recruitment and 
J I employment goals? 

E>ate Needed: March, 1991 



EVALUATION QUESTIONS 



INFORMA TION SOURCES 



1 - L Is the District making progress 
in its efforts toward meeting 
FSR long-term goals? 

a. What is the ethnic break- 
down of the AISD: 
Professional population? 

. Administrative population? 



AISD Personnel Records 



b. What is the sex breakdown of 
the AISD: 

Professional population? 
Administrative population? 



AISD Personnel Rea>rds 



1 'Z How does AISD compare with 
Texas as a whole in terms of 
ethnic and sex distribution? 



a. What is the ethnic break 
down of the Texas and U.S.: 
Professional population? 
Administrative population? 

b. What is the sex breakdown of 
the Texas: 

. Professional population? 
Administrative population? 



Texas Education Agency 
(TEA) Records 
Reference Materials 



TEA Records 



1-3. Is the District meeting its recruit- 
ment and hiring goals? 



What is the ethnic break- 
down of the AISD newly 
hired: 

Professionals? 
Admin^trators? 



AISD Personnel Records 



ERIC 



M2 



113 



9ao7 




EVALUATION QUESTIONS 



INFORMATION SOURCES 



h. What is the number and 
percentage of student 
teachers in AISD by ethnic- 
ity? 



Office of Student Teaching 
Ethnicity Report 



What efforts exist in AISD to 
interest students in teaching 
(e.g.. Future Teacher Clubs, 
National Science Founda- 
tion efforts)? 



OfTioe of Student Teaching- 
Secondary Sf a(T Develop- 
ment 

Personnel Director Inter- 



view 



School Club Sponsors 



What are the characteristics of 
the Texas teacher pool? What 
are the passing rates by ethnicity 
for the: 



TEA Records 



Texas Academic Skills 
Program (TASP) test, and 
the 

Examination for Certifica- 
tion of Educators in Tocas 
(Ex-CET)? 



1-5. What is the District doing to 
recruit and retain minority 
professional and administrator 
applicants? 



Personnel Director 
Interview 



1-6. How many AISD high school 
students express an interest in 
teaching as a career? By ethnic- 
ity? 



Districtwide Student Survey 
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DROPOUT PREVENTION 



EVALUATION PLAN 



Qmtsct 7ers<m: 

Linda Frazer 



PROGRAM DESCRIPTION 

The Austin Independent School District has many activi' 
ties and programs which directly or indirectly are intended 
to reduce the dropout rate or keep the rate firom increas- 
ing. This evaluation plan assesses the dropout rate for 
AISD. 
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Education I Should the District modify its activities intended to reduce the 
Issue I dropout rate? 



Date Needed: January, 1991 



EVALUATION QUESTIONS 



IN FORMA TION SOURCES 



hi. Is ihe dropout rate changing? If 
so, why? 

1 -2. Whai has been the history of 
increasesAlecreases in annual 
dropout rates since 1983-84? 

a) by ethnicity? 

b) by grade? 

c) by sex? 



Dropout File 



Dropout File 



1-3. What was the annual dropout 
rate at grades 7-12: 

a) by ethnicity? 

b) by grade? 

c) school? 

d) by sex? 



Dropout File 



1-4. Is AlSD's dropout rate bciier or 
worse than other disricu»' rate? 



Dropout File 

State Dropout Report 



1 -5. Which schools are effective in 
lowering their dropout rates? 
Why are they effective? 



Dropout File 



1-6, What are the dropout rates for 
students who were first in ninth 
grades in 1983-84, in 1984^, in 
1985-86, in 1986-87, in 1987-88, 
in 1988-S9, and in 1989-90 as of 
the fall of 1990: 

a) by ethnicity? 

b) bysex? 



Dropout File 
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Education 

Issue 1 
Continued 



1-7. What are ihe dropout rates for • Dropout File 

students who were first in 
seventh grades in 1^-85, in 
1985-«6, in 1986-87, in 1987-88, 
in 1988-89, and in 1989-90 as of 
the fall of 1990: 
a) by ethnicity? 
by sex? 



1-8. What is the dropout rate 
for: 

a) LEP students? 

b) Special education students? 

c) Students from low income 
families? 



Dropout File 
Language File (LANG) 
Special Education File 



\ -9. What percentage of 
dropouts are: 

a) LEP students? 

b) Sp^al education students? 

c) Students from low income 

families? 



Dropout File 
LANG 

Special Education File 
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PROGRAM DESCRIPTION 



DISTRICTWIDE 
SURVEYS 
(Employee, Student and Parent) 



EVALUATION PLAN 



Sedra Spano 
David Wilkinson 
Catherine Christner^ Ph.D. 



Districtwide surveys are an eflidenl way to meet a number 
of AISD data needs. Surveys: 

Satisfy the requirement for an annual survey of 
professionals on job satisfaaion aiKl other issues of 
districtwide importance (the requirement b based on 
a comultation agreement with the Austin Assodation 
of Teachers in 1987-88). 

Meet the needs of AISD decision makers for input 
from students, parents, professionals, and administra- 
tors on issues of general concern to the District, such 
as quality of education, biggest school prcAlems, and 
school dimate. 

Serve as a source of information about spediic AISD 
programs, services, and polities (eg.. Priority Sdiools, 
extracurricular transportation, and no passAK) play). 
Meet data colleaion needs of multiple project 
evaluations by gathering information on program 
implementation, efleaiveness, and needs (from 
students, professionals, and administratora). 
Provide vocational counselors with information atK)ut 
the vocational course interests and job needs of 
students. 

Reduce paperwork, save staff time, and improve 
coordination collecting data through one survey 
process rather than through a number of separate 

surveys. 

Employee surveys have been conducted annually since 
1979-80. Student surveys have been conduaed annually 
since 1983-84. A districtwide survey of elementary parents 
(the first of this scope) was conducted in 1987-88. A 
secondary parent sur\^ was added the following year. 

In 1989-90, a record 73,793 surveys were distributed. Sur- 
veying this many persons while tfying to minimize their 
paperwork burden has been made possible by a sc^histi* 
cated computerized system which allows sampling sudi 
that each respondent receives a limited number of the 
toul items. For example, each teacher reodved ik3 more 
than 24 of the 280 confidential items asked in 1989-90. 
Ukewise, survey responses to 93 items wen gathered from 
over 13,000 students, but each student received no more 
than 24 items. 



Tipping the viewpoints of those who work for, and arc 
served by, AISD continues to grow in imporunce. The 
anonymofifi stuvqr items which are directed to im>fessioQ- 
als to gauge their fob satisfactton wil! C3S'^«^ to be ad- 
minist^ed in the ^ning. The confidential iteou submitted 
to staff to eltdt vtews on a broader range at topics will also 
continue to be administered in the spring (1991). 

The student survey, which has traditionally been the vehicle 
for obtaining vocational course preference information 
from high school students (grades 9-12), has grown over 
the years to include other topics of concern to secondary 
education personnel. 

For the third consecutive year, parents will be surv^eyed at 
both the elementary and secondary levels about issues of 
districtwide interest, eg., quality of education in AISD, 
scliool climate, and effective schools. 

A portion of the time of the Chapter 1 staff will be devoted 
to coordinating the elementary parent survey (as part of 
the Priority Schools evaluation). A portion of the Sys- 
temwide Evaluation staffs time will be devoted to assisting 
with the elementary survey and conducting the secondary 
parent survey. The elemenury parent survey will be 
computer-generated again this year, computer programmer 
resources are therefore essential. 

Student survey items will be solicited from appropriate 
staff later this fall Some items from last year will remain 
intact; however, it is anticipated that some topics and items 
will be different, e.g., the itemr related to drug and alcohol 
abuse, items for the confklential portion of the employee 
survey will be finalized this spring, with input provided by 
appropriate staff. 

A portion of the time of the Systemwide Hvaluation 
evaluation associate will be devoted to the survey effort, 
among other tasks. General supervision will be provided 
by the Systemwide Evaluation evaluator. Computer pro- 
gramnner resources will also be essential. 

The basic evaluation questions to be addressed will remain 
the same b% last year but many specific topics and items are 
likety to be different The examples provkSed on the next 
page represent topks covered last year pita some that are 
anticipated for 1990-91. 

Information sources for all questions are the staff, student, 
and parent surveys. 
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Should AISD programs, policies, and procedures be 
continued as they are or be modified? 



Date needed: May, 1991 
EVALUATION QUESTIONS 



11. What are the opinions of AISD 
professionals in areas relating to 
school/climate effectiveQess? 

M What arc AISD students* 

opinions regarding vocational 
course interests and job needs? 

1-3. What are AISD students' 

opinions regarding topics of 
genera] interest? Examples: 
No pass/no play 
Quality of sdiool educa tic n 
School climate 
AlSD*s greatest strengths 
The biggest problems for 
schools 

Date needed: December, 1990 



1 -4, What are AISD parents* opin- 
ions regarding topics of general 
interest? Examples: 

. Quality of school education 

School climate 
. AISD's greatest strengths 
. The biggest problems for 
schools. 
Date needed: March, 1991 



1-5. What do middle^unior high 
school students report about 
their invotvement with drugs and 
alcohol and about other matters 
(e.g., pregnancy)? 

Date needed: January, 1991 



1 -6, What are AISD staffs opinions 
on i^ues of general interest dis- 
trictwide? Examples: 

Quality of school education 
School climate 
AISD strengths and prob- 
lems 

AISD-funded programs, 
services, and policies (e.g., 
A-f , Priority Schools, AIM 
High, No pass/no play, 
secondaiy honors, elemen- 
tary management, paper- 
work, LAMP, dropouts, 
Adopt-A School, Cable TV, 
pro£ -ams for LEP students, 
TAAS). 

1-7, Do project staff and AISD staff 
overall believe grant-funded 
programs are effective? What 
needs can be identified? Ex- 
amples: 

Oiaptcr 1/Chapter 1 
Migrant (including Priority 
Schools) 
• Title VII 

Chapter 2 (Elementary 
Computer Labs, Technolgoy 
Education, Extracurricular 
Transportation, etc) 
SchooLCommunity Guid- 
ance Center 
Drug-Free Schools 
National Sdence Founda- 
tion 

Date needed: May, 1991 
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STUDENT 
ACHIEVEMENT 



TECHNICAL REPORT 



Contact Person: 

Evangelina Mangino 



INTRODUCTION 

The Systemwide Tesong Ptagram coonisiMM the administra- 
tk)n and jractssmg of achtevmem tests aid 
crf^ their results. The pn^iBm ^ also desi^ml to assist AISD 
acbninistraiors^ teachos, studrats, md parems in the use of 
ttrhkvemem dtfa in the following areas. 

To inve^g^ the overall impact of AISD^s pfograms on 
majcmty ffixl mincHity student achievemait u the EHstrici 
and campus levels. 

To kteittify students eligible for ranedial and ainchmenl 
programs, as well as the regul^ in^nictkmal programs, 
To provide achievonem data used for the evalutfim of 
remedial and emKhment progiams, as irall as the regular 
ii^tructiona] |»T^rams, 

To r^K^ ba^ infonnaticHi on ttudent achievement to 
the ScIkx4 Boanl mui the general i^ltc. 
To maintain Texas Assessment (rf* Acad^ic Skills 
(TAAS) Exit-Level snd Texas E^hxratima] Asacssmeni 
of Minimum Skills (TEAMS) Exit-Level files to deter- 
mine stutfents* «atus for high school graduation, 
To idoitify and respmd to achievemem-rdated infwma- 
tion and resource needs of the School Boards campus and 
centra] office administrators, teachers, counsek^ and 
parents, and 

• To identify schools pei forming higl^ and lower than 
schools with similar populations. 

In additic^ to the coordination of tests ^ report of their 
results, the sy^emwitte testing iHogram participate in the 
following activities: 

TAAS practice tests scoring tervices, 
End-of-bocA testing for dementary stu<tents 
Assisting TEA with the fiekl tests as required by State 
law, and 

Assist on the State Assessment aod the Naticmal Assess- 
HK^t of Educational Progress (NAEP). 

A majOT effort for iiK Systemwide Testing Program will be to 
make the TEAMS the TAAS transitim which is taking 
effect in the 1990*91 school year. 
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Question I ^^^"^'^ District modify its 1991 -92 plan for improvement in 
/ I basic skills achievement based on TAAS results? 



EVALUATION QUESTION 1 

Is AISD*s instructional program successfully teiK^hing stiKtents the duUs required 
to masicx the TAAS objectives? 



I'l. What percentage students 
mastered the TAAS test in 
mathematics, reading, and writing 
in grades 3, 5, 7, ami 9 at the 
''minimum skills/ '*acactemic 
skills/ and^ac^mic 
recognition'* levels; 

a) By sex? 

b) By ethnicity? 

c) By low-income status? 

d) By LEP status? 



INFORMATION SOURCES 

• Texas Asses^ent of Aca- 
demic Skills (TAAS) File 
(2/1/91) 



How do the three mastery levels 
AISD compare with the State 
mastery results? 



in 



TAAS File 
TAAS State Report 



1-3. How did AISD students (total and 
by ethnicity, imrcMne status, and 
LEP status) perfcHin on the 
TAAS, grades 3, 5, 7, and 9: 

a) Compared to other urban 
districts? 

b) Compared to other Texas 
school districts? 

c) CcMnpared to the State aver- 
ages? 



TAAS Flic 

Joint Urtoi Evaltiation 
Council (JUEC) TAAS 
Summary 



1-4, How did students perform at e^h 
campcs? 



• TAAS File 



1 -5. What perocnlage of AISD LEP 
and Special Education ttudents 
wcie tested on the TAAS? 



TAAS File 



1 -6. How many schools wone idoitified 
as low-achieving campuses by 
TEA and how does this compare 
with: 

a) Other uibffii districts? 

b) Previous years? 



♦ TEA List of Low-Achieving 
Campuses 
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Question I Should the District modify its instnictional strategies for 
2 I preparing students to master the Exit-Level TAAS? 



EVALUATION QUESTION 2 

1$ AISD*s tfiAnictiona] prograni siK:cessfuUy teaching students the skills mquiivd 
to master the TAAS t^jonives? 



2- 1 . How many and what percentage of 
the sentcm with all ottw require- 
ments fOT graduaik»i compl^ol 
were denied a diplmia as a result 
of not mastering the Exit-Level 
TEAMS or TAAS? 



INFORMATION SOURCES 

AAS File 

& 5/15/91) 

• Graduate File (7/15/91) 

• TEAMS File 



2-2. How many and what percentage of 
eleventh-grade students met the 
mastery criteria on the Exit-Level 
TAAS: 

a) At the first admini»'-^on? 

b) At the retesting? 

c) Overall? 



TAAS File 
(2/1/91 & 5/15^1) 



2-3. How did eleventh graders perform 
on the Exit-Level TAAS: 

a) By sex? 

b) By ethnicity? 

c) By low-income status? 

d) By LEP status? 



TAAS Flic 
LuiK:h File 
LANG File 



2-4, How did eleventh graders perform 
on the writing sample? 



TAAS File 



2-5. How did AISD students (total and 
by ethnicity, inccMne status, and 
LEP status) perfcMin on the Exit- 
Uvd TAAS: 

a) Compared to cMher 
urban districts? 

b) Compared to other 
Texas sctK)ol districts? 

c) Ccnnpared to ibc State 
averages? 



TAAS File 

Texas Education Agency 
(TEA) Data Tapes 
TAAS State Report 



2-6. How did stiKknts perform at each 
campms? 



TAAS File 
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Should the Disi ^ct modify its plans for improvement in basic 
skills achicveme U based on norm-referenced test results (i.e., 
ITBS and TAP)? 

EVALUATION QUESTION 3 

Is AISD's instructional program successfully teeing students the skills required 
to compete successfully with students nationwide? 

INFORMATION SOURCES 

3-1. How did AISD's 1990-91 student • Iowa Tests of Basic SkiUs 
achievement compare, by (UBS) File (5/14/91) 

ethnicity, lo the students: • Tests of Achievement and 

a) In the nationwide nomiing Proficiency (TAP) (5/14/91) 
sample? 

b) In the urban district nonning 
sample? 



Decision 
Question 
3 



3-2. What percentage the students in 
each ^nic group sccHcd in the 
higher and lowest ranges of the 
ITBS and TAP? 

3-3. How laige were the achievement 
gains made by AISD students in 
1990-91. by ethnicity? 



ITBS File 
TAP File 



ITBS File 
TAP File 



3-4. How did AISD's 1990-91 student 
ach^vcmoit compare, by 
ethnk:ity, to the achievemrat of 
students in 1-12 across the last 
three years? 



ITBS File 
TAP File 



3-5. What were the achievement levels 
of AISD students, by ethnicity, 
who qualified for a free or 
reduced-phced meal: 

a) In 1990-91? 

b) Compared to the achievement 
of low-income student frcnn 
previous years? 



L4mch File 
ITBS File 
TAP Flic 



3-6. Which scJkx>1s showed achieve- 
ment in reading and mathematics 
higher or lower than schools with 
similar pqpuUttions? 



ITBSFde 
TAP File 

Report on School EfTective- 
ncjs 



3-7. What are the mean grade equiva- 
lent (GE) achieven^t gains of 
LEP studenu ^ to be tested in 
English in 1990-91? 



Iowa Tests of Basic Skills 
(ITBS) 

Tests of Achievement and 
Proficiency (TAP) 



ERJ.C 



90.07 



m 



Information 
Needs 



INFORMATION QUESTIONS 

M How did ihc AISD 199(V91 
graduates who lock the SAT 
compart with oii^ students 
naikHiwtde: 

a) In reading and math? 

b) In partkipaticm rates? 

c) In previous years? 



INFORMATION SOURCES 

Scholastic Aptitude Test 
(SAT) Rc^jort 



1-2, Who in AISD in 1990-91 received * DLstribuuon of 

achievement results from the Reports List 

following tests: 

a) Metropolitan Readiness Tests? 

b) ITBS? 

c) TAP? 

d) TEAMS? 

e) Placement Tests? 



1-3, What questions were asked in • ORE Documentation 

1990-91 by the School Board, the 
Superintendent^ and central and 
campus administrators? What 
answo' or action was taken with 
each question? 



What percentage o( LEP students • TA AS File 

were not tested with English • LANG File 

TAAS bccaise they were: 

a) Exempt? 

b) Tested in Spanish? 



1-5. How docs the percentage of LEP • TAAS File 

students exempted and t^ted in • JUEC TAAS Summary 

Spanish compare to the percent- 
ages of ttnr urban districts? 
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Iftformation 

Needs 
Continued 



INFORMATION QUESTIONS 



INFORMATION SOURCES 



1-6. Special Educaiion testing status of 
AISD students. 



16-1. What percentage of stiKknts are 
exempt from testing: 

a) On the ITBS and TAP? 

b) OntheTAAS? 

15-2. How does the percentage ex- 
empted on TAAS compare with 
other urban districts? 



ITBS File 
TAP File 
TAAS nie 



TAAS File 

JUEC Summary File 



16-3, How did the number of special 
ediK:ation students tested or 
exempted in 1990-91 compare to 
{Hcvious years? 

16-4. How many and what percentage of 
students graduated with a ^xx:ial 
education exemf^tm on the Exit- 
Uvel TEAMS or TAAS: 

a) By handicaj^ing c^mdition? 

b) By number of hours per day of 
special education in^niction? 



ITBS File 
TAPRlc 
TAAS File 



TEAMS & TAAS FUe 
Graduate File 



1-7. How did AISD snufents perfomi 
on placen^nt te^ (e.g., (X)LT, 
Advandcd Placement ) in 1990-91? 



Computer Literacy Test 
(COLT) File 

Advanced nacemoit Test File 



1-8. What procedures were set up fw 
coordinating and administering 
advanced pl«%nient tests in 
1990-917 Do they need to 
be revised? 



ORE Docun^ntation 



1-9. How many schools are using ORE 
scoring services for the Region 
XIII TAAS pr«:tjce tests? 



• Practice TAAS Test File 
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PROGRAMS FOR 

PROFIOENT (LEP) 
STUDENTS 



EVALUVriON PIAN 



Coilt8d>«r9«ll^: 

David VViii^ftson 
Sedra Spano 



PROGRAM DESCRIPTION 

Texas law requires i>at all students with a language other 
than English (LOTE) be processed to determine their 
English proficiency. Those ideniifled as limited English 
proflcient (LEP) must be provided one of two basic 
programs: 

Transitional Bilingual Education (TBE) a program of 
duaManguage instruaion, including a state-required 
minimum of 45 minutes of English-as-a-Second- 
Langrage (ESL) instruction, provided to students 
with Spanish, Vietnamese, and Korean language back- 
grounds, and 

English as a Second Language (ESL), a program of 
specialized instruction in English provided to students 
whose parents refuse dual-language instruction and lo 
other LEP students not receiving bilingual education 

Some LEP students are served by special education only 
or through modified methods of instruction. 

In 1989-90, by agreement with the Texas Education 
Agency, another option was made available only for those 
Hispanic students who were classified as C (bilingual), D 
(English dominant), or E (English monolingual) as of 
May, 1989. These "old" CDE students may be assigned 
through their Language Proficiency Assessment Commit- 
tees (LPACs) to the Language Arts Mastery Process 
(LAMP), an oral language development program con- 
ducted in English. TTiis is not an option for newly idenii- 
fled C D, or E students. 

A portion of one evaluation associate's time will be 
devoted to monitoring the progress of LEP students, 
especially in terms of English achievement- Last year 
(1^-90), the monitoring of LEP C, D, and E students 
was another component of the evaluation. This year those 
students will continue to be tracked. As r^urces allow, 
management information will also be provided through 
the computerized file of all LOTE students in the District. 
Supervision will be provided by the Systemwide Evalu- 
ation evaluator. 

Other evaluation plans including questions related to LEP 
students are Priority Schools, Chapter lAi^apter 1 
Migrant, Dropout Prevention, Retention, Title VII, and 
Systemwide Testing, Evaluation findings about LEP 
students will be presented in the final evaluation reports 
for these projects* 
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Alt limited-English-proficient (LEP) students 
i I receiving an instructional program appropriate 
to their needs? 



Date Needed: June, 1991 



EVALUA TION QUESTIONS 



INFORMA TION SOURCES 



Findings from Evaluation Questions 1-1 through 1-5 will be reported in 
the final report on student achievement for 1990-91. 



1-1 . What percentage of AISD LEP 
students tested in English 
showed mastery of the TAAS by 
grade? Compared to the State 
average? Compared to past 
years? 



TAAS (English) 



1 -2. What percentage of AISD LEP 
students were lated in English 
and Spanish on the TAAS by 
grade? 

1 -3. What percentage of AISD LEP 
third graders tested in Spanish 
mastered the TAAS? Compared 
to the State average? Compared 
to past years? 

1 -4. How do AISD's LEP mastery 
rates compare to the rates for 
LEP students in the other 
"Big 8" districts? 



TAAS (English) 
TAAS (Spanish) 



TAAS (English) 
TAAS (Spanish) 



TAAS (English) 
TAAS (Spanish) 



1 -5. What are the mean grade 

equivalent (GE) achievement 
gains of LEP students able to be 
tested in English in 1990-91 and 
1989-90? By grade? By lan- 
guage? By dominance? 



Language (LANG) File 
Iowa Tests of Basic Skills 
(ITBS) 

Tests of Achievement and 
Proficiency (TAP) 
Report of School Effective- 
ness (ROSE) 
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Key 
bsuel 
Cor.tirmed 



Findings firom evaluation question 1-6 will be feported in the 
final report on AISD dropouts for 1990-91. 



EVALUATION QIESTIONS 

1-6. How many L£? students drop 
out? Compared to other AiSD 
students? How many LEP 
students are identified as "high- 
risk"? 



INFORMATION SOURCES 

Office of Research and 
Evaluation GENeric Evalu- 
ation system (GENESYS) 



Findings from evaluation question 1-7 will be reported in the GEr»IESYS final report. 

1-7. How did the LEP students being • GENESYS 

served compare to the LEP 
students with a parent denial of 
service in terms of: 

Achievement? 

Attendance? 

Discipline rates? 

Grades? 

Retention rates? 
Dropout rates? 

Findings from evaluation question 1-8 will be reported in the final report on retention. 



1-8. How many LEP students vferc 
retained in 1990-91, by grade 
level? 

1-9. "What is the tureofAISD's 
LEP population? 

By grade? 

^school? 

By language? 

By dominance? 

1^ parent denial status? 
• By program (e.g., THE, ESL, 

LAMP)? 

By age? 

By special education status? 
^discipline status? 
By attendance? 
By dropout status? 
By retention stat* 
^length of serviw? 
By oompensatoiy education 
status? 

' By giftedAalented status? 



Retention File 

Student Grade Reporting 

(SGR) File 

• LANG 

-October count 
-June count 
GENESYS 

• Gifted/Talented File 
Overlap Study File 
Immigrant File 

• Big File 
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ICey 
Issue! 
Continued 



EVALUATION QUESTIONS 



INFORMA TION SOURCES 



1-10. What is the impact of the revised 
guideUnes for identifying LEP 
students on the number of 
students assigned to exh 
language dominance category? 

Ml. What changes, if any, have 
occurred in the Distria's 
programs for LEP 
students? 



Employee Survey 
GENESYS 
LANG File 



LANG File 



1-12. How many •old* CDE students 
were placed in bilingual, ESU or 
LAMP? How many: 
. Changed programs? 
. Changed dominance? 
. Exited? 



Annual Reviews 
LANG File 



1-13. What was the performance of 
students identified as ""not 
LEP* in 1989-90 who would 
have been LEP in 1988-89: 
. As of spring, 1990? 
. As of spring, 1991? 



GENESYS 
Annual Reviews 



1-14. What compensatory services 
were provided to students 
identified as 'not LEP* but who 
are "educationally disadvan- 
taged*? 



LANG File 
Overlap Study File 



1-15. How many bilingual transfers . Transfer File 

were there in 1990-91? From 
what schools? For what 
languages? 



1-16. What was the cost of * Budget Records 

transferring students to bilingual - Personnel Administrator 
centers in relation to the cost of Interview 
hiring additional teachers? 
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^Conthui&t 



INFORMATION QUESTIONS 



IN FORMA TION SOURCES 



Which LEP students are eligible 
to exit based on achievement and 



Annual Revie\^'S 
LANG File 



1-2, 
1-3. 
1-4. 

1-5. 



proflciency test scores? How 
many LEP students exited in 
1990-91? What was their 
average number of ye^irs in LEP 
programs? 

How many students reentered LANG File 

LEP programs in 1990-91? 

How many 1990-91 graduates GRAD File 

were LEP or formerly LEP? LANG File 

How many certified bilingual • Teacher Survey 

teachers are not teaching 

bilingual students? ESL- 

endorsed teachers not teaching 

ESL? 

Under what conditions are - Teacher Survey 

bilingual certified and ESL- 
endorsed teachers teaching? 

- How many students do they 
have? 

' What are the students* 
language dominances? 

• How many students arc 
nonliterate? 

- How many preparations do 
they have? 

- How interested are teachers 
in transferring? 

• How many have split grade 
assignments? 
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GENERIC 
EVALUATION SYSTEM 
(GENESYS) 



EVALUATION PLAN 



Contact Person: 

David Wilkinson 



PROGRAM DESCRIPTION 

GENESYS is a GENeric Evaluation System. 

GENESYS is a method of str^mlining data o^Uection 
and evaluation throogh use of computer tedmology. 
From its fintyear in 1973, tlie Oflkeof Reseaicb and 
Evaluation (ORE) has been cballenged to evaluate a 
multitude of diverse programs «4tli limited resources. By 
standardizing methofte and information provkted to 
persons requiting data, GENESYS makes it possible to 
evaluate a mudi larger number ami variety of programs 
than would ordinarily be possible. GENESYS gathers 
and reports the following standard information on 
specified groups of students: 

. Student characteristics 

. Achievement 

. Attendance 

. Discipline 

. Grades/credits 

. Dro'^uts 

. Retainees 

GENESYS can be run for any group identifiable through 
a computer file. Since 1988-89, the first year in which it 
was run, GENESYS has included a wide variety of 
elementaiy, secondary, and K-12 programs. The programs 
likely to be included in 1990-91 are listed below. Addi- 
tional groups will probably be identified daring the course 
of the year for which information will be required. 

Prelected 1990-91 GENESYS Groups 
K-12 



BilinguaVESL Programs 

Communities in Schoob (CIS) 

Drug Abuse Resistance Ediuatton (DARE) 

Peer Assistance Le^lerUiip (PAL) 

Project Mentor 
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Dementary 

AIM (Ability, Interest, MotivatioD) High 
BUdshear Computer Lab 
. Blanton WICAT Computer Lab 
Project Teach and Reach 
Read Bridge Computer Lab 

Secondary 



Program 
Description 

continued 



Alternative Learning Center (ALC) 

Academic Incentive Program (AIP) 

Coordinated Vocational Academic Education 

(CVAE) 

Dropouts 

Evening School 

Johnston Computer Lab (JCL) 

Kealing Magnet 

Liberal Arts Academy 

Practical Effective Application of Knowledge 
(PEAK) 

Pregnancy, Parenting, and Education (PEP) 
Pilot 

Project GRAD (Gram Research About Drop 
outs) 

Robbins Secondary School 
Science Academy 
Secondaiy Honors Program 
Sixth Graders 
Title VII 

Transitional Academic Program (TAP) 
Work Inventive (WIN) Program 
Zenith Program 



Given a file of those students involved in a program, group, 
or innovation, GENESYS provide outcome information 
for the following variables: 



Group Characteristics : Number served by grade, 
ethnidty, sex, low income, LEP, overage for grade, 
spuria] educatk>n, and gifted/talented; 



R-2 



AchicvCTiCTt Rcgqlts bv Grade : ITBS, TAP, TAAS, 
an^ ROSE regression trend information; 

Attendance. Discipline. Grades/Credits : four semes- 
ters; 

DropQuis and Retainecs : Counts as of the end of the 
fifth six weeks for dropouts and potential retainees as 
of the end of May. 



For each group, three standard listings arc produced: 



The GENESYS Program Summary summarizes 
information on it^ groups overall performance on all 
variables. 



Program 
Description 
continued 



The Ex^tivc Summary summarizes findings in 
narrative form and compares the group's data to 
appropriate districtwide groups. 

GENESYS Data bv Student provides a listing of this 
information by individual student (as applicable) for 
review and reference, 

TWO optional printouts can be requested by the user: 

Cross-Program Comparison Chans provide a sum- 
mary of statistics across multiple programs designated 
by the user. 

Two-Wav Crosstabulation Tables provide a greater 
level of detail about seleaed variables than that 
provided in the evaluation summaiy. 

Information sources for all of the following questions are the 
a)mpuier files accessed by GENESYS. 
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What do outcome data from AISD computer files 
indicate atK)ut the status of students in special 
programs or other identifiable groups? 

Dale Needed: July, 1991 



EVALUATION QUESTIONS 



INFORMA TJON SOURCES 



1-L Whal were ihc demographic 

characteristics (number served, 
ethnicity, sex, etc.) of the 
students in the special programs 
or identified groups? 

1-2. What were the attendance rates 
for students in the special 
programs or identified groups? 

1 -3. How many discipline incidents 
occurred among students in the 
special programs or identified 
groups? 



Computer Files 



Compuicr Files 



Computer Files 



1-4. What were the grade point 
averages (CPA's) earned by 
students in the special programs 
or identified groups? 



Computer Files 



1-5. How many course credits were 
earned by the students in the 
special programs or identified 
groups? 



Computer Files 



1-6. How many Fs and NG^s (no Computer Files 

grades) were received by the 
students in the special programs 
or identified groups? 



What were the dropout rates for 
students in the spedal programs 
or identified groups? 



Computer Files 
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EVALUA TJON QUESTIONS 

How many students in ihc 
spccia! programs or idcntidcd 
groups were rclaincd? 

1-9. What were ihc achievement 
levels of the students in the 
special programs or identified 
groups? 



INFORMA HON SOURCES 
Q)mpuier Files 



Computer Files 
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fflSTORICAL 
STUDENT 

RETENTION 
IN GRADE 



PROGRAM DESCRIPTION 



Hie Historical Student Retendoi in Grade rqxM omtains 
dataamcemingttemsnbercrf^ studems tfitt repeat a gr^ 
level. It is a comiHlittion of retention statistkrs over tioK. 
The leport is prodi^ twice yearly, once after the ^ of the 
scbocA year (pMential imiroes ^ idded to the rcpra), nd 
OiHX after the b^inning of the next school year (act 
retainees acbted lo the fq)on). The mo^ recent analysis, 
in the form of tabtes and grq)hs, is included in the rqxKt. 
This analysis uses the nnm recent data as well as knigitudina] 
retention statics. 



EVALUATION PLAN 



Contact Person: 

Vince Paredes 



S-J 
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What does information fix)m District computer files indicate 
about trends and policies concerning the retention of AISD 
students? 



EVALUATION QUESTIONS 



INFORMATION SOURCES 



1-1. What are the most recent retenuon 
rates given by grade and by 
particular grade sp^Dsl 



Student Master File 
Av^ge Daily Membership 
File 



1 -2. How do the most recent rcicntion 
results compare with past years? 



AISD computer files 



1-3. What are the present and past 

statistics concerning end-oT-year 
potential rctainees as a perccniagc 
of: 

a) Average daily membership for 
Ihcyeir. 

b) End-of-ycar membership? 



Student Master File 
Elemoitary Potential Retainee 
File 

Student Grade Reporting 
(SGR)Filc 



1-4. What are the i^sent aiKi past 

statistics concerning beginninf -of- 
year actual xiainees as a 
percentage o:: 

a) Average daily membership for 
the previous year, 

b) End-of*year membership for 
the previous year, and 

c) Fall enrollment? 



AISD computer files 



1 -5. How many UEP midents w^ 
retained in 1990-91, by grade 
level? 



• Elementary Pocemial Retainee 
File 

• SGR File 



1*6. What is the attitude of teachers 
toward relcmicn? 



ERIC 
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PROGRAM DESCRIPTION 



PROJECT A+ 

ELEMENTARY TECHNOLOGY 
DEMONSTRATION SCHOOLS 



EVALUATION PLAN 



Coalact Fersmis: 

Linda Frazer 
Paula Marable 



In a study conducted between 1985 and 1989 in the Austin 
Independent School District (AISD), 27 J% of the 9th 
graders in 1985 dropped out before graduation. These 
numbers parallel data at the national level. 

One factor that many dropouts have in common is that they 
are ovengc for their grade level. In m<»t cases they are 
overage from being retained at an earlier grade level. The 
results of a research study in AISD state that 33% of all 
overage students in grade 9-12 drop out each year. 

In many cases students that are overage in high school were 
retained at the elementaiy level. Presently, 18-7% of the 
elementary students in AISD are overage by at least one 
year which places them at-risk for being dropouts. It is 
dear that a major emphasis must be made at the elemen- 
tary level to get and keep students on grade level. 

Preventing students from falling behind and having to 
repeat grades is predicted to lead to a significant decline in 
the dropout rate. Therefore, keeping students on grade 
level academically in elementary schools should b«»me a 
major priority for this District. 

The primary purpose of this AISD/IBM A+ Project is to 
demonstrate the effectiveness of technology in accelerating 
the learning of low Sieving at-risk elementary students 
and enhancing the education of high achieving students so 
that the overall Project A+ goal is realized~all students 
functioning successfully at or beyond appropriate grade 
level. 



IBM became involved in Project A+, which is part of its 
nationwide efforts to improve education, through its 
panicipation in the Washington-based Business 
Roundtable. The Roundtable, an association in which the 
200 largest corporations examine public policy issuer, nas 
decided to foci» on working in the field of education. 
Project A+, a partnership between IBM and AISD, is a 
long-term effort to make AISD a workl-dass school 
district 
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Three Austin elemeotaiy schools (Andrews, Patton, and 
Langford) will receive S4.4 million worth of computer 
equipment and software firom the IBM Corp. This is the 
largest grant the company has made to a school district and 
the grant is the largest received in AISD history. 



Program 
continued 



Apple Inc. has chosen to be a partidpant in this technology 
plan for elementary sdiools and has donated $74,700 to 
AISD. Galindo Elemenuiy will be the Apple sdiool The 
four elementary schools partici{»ting in the projea were 
selected l^m over 40 schools that applied. 

The evaluation of Project A+, while taking into account 
the ongoing nature of the program and the short duration 
of its implementation, will focus on the eff^niveness of the 
program to date and those aspects of it which might be 
replicate at other schools. 
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Key Issue: How effective Is the technology plan for elemental^ schools 
in improving the achievement of all students and reducing 
the risk for students at risk of dropping out of school? 



Educational | y^^^ implemented as designed? 

Issue ■ 



DateNeed^: June, 1991 



EVALUATION QUESTIONS 



IN FORMA TION SOURCES 



I'l. What was the plan for implementation? 
M Were there changes to the plan? 

l-3« Was any supplementary technology 
(Le.t laser disks, multi-media, etc) 
added to the project? 

1-4. What implementation problems were 
encountered? What recommendations 
were made for improvement? 

1-5. What were the characteristics of 
the students and the schools? 



Detailed plan 
Staff Interviews 

Staff Interviews 



Siaflf Interviews 



GENESYS 



1-6, What were the educational activities 
undertaken in the project? 

1-7. How much time per week (on the 
average) did students receive 
instruction on the computers? 

o Overall 

o By subject 

o ]^ school 

o ^grade 

o By grade by subject 
What factors led to differential 
participation? 

When did instruction begin at each school? 

1^. How many parents were involved? 
How were parents involved? 



Staff Interviews 
Site Visits 

To Be Determined 
with IBM and Apple 
School Records 
Site Visits 



School Records 
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Educational 

Issue 
1 

Continued 



EVALVA TION QUESTIONS INFORMA TION SOURCES 

1-9. What training was provided to staff 

(dates, topics, number of sessions, ^ Interviews 

number attending, hours, sUpends)? Records 

1*10. Can individual components of the All sources 

plan be isolate as effective or 
inefTective? 



Educational ■ How effective was the technology plan? Should the pro- 
Jssue I gram continue as is or be modified, or discontinued? 
£ I Should it be recommended for replication in other schools? 

Date Needed: June, 1991 
EVALUA TION QUESTIONS INFORMA TION SOURCES 



2-1. Were the following program 
objectives met? 

o To accelerate the learning 
of all students? 

o To accelerate the learning 
of low-achieving students? 

o To enhance the learning 

of high -achieving students? 

o To lower the risk of at-risk 
students? 



ROSE 
ITBS Files 

ITBS Files 



ITBS Files 



At Risk Files 
GENESYS 



To decrease the number of 
retained students? 



Staff Interviews 



To provide summer school 
for those not osl pvde level 
at the end of secoiKl grade? 



Retention Files 
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Educatumal 
Issue 
2 

Contmued 



EVALUA TION QUESTIONS 

2-1 What elements need to be 

present to expand the plan to 
other schools? 



INFORMA TION SOURCES 
Staff Intervicv^'s 



2-3. Was the proj«n considered 

effective? What aspects seemed 
most effective? 



All Sources 



2-4. What was the cost per unit of 
effectiveness (cost per month of 
grade gain per student)? Com- 
pared with traditional meth- 
ods? 

2-5. Did teachers' willingness to 

employ technology in their in- 
struction increase through par- 
ticipation in the project? Did 
staff consider A+ to be effec- 
tive? 



Finance Records 
ROSE 



Teacher Survey 
Principal Interviews 



lERLC 
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Educational 
Issue 
3 



How effective was the implementation of telephones in the 
classroom? Should it be recommended for implementa- 
tion in other schools? 



Date Needed: June, 1991 



EV^ LUA TION QUESTIONS 



INFORMATION SOURCES 



3-1. What was the plan for implementation? 



Staff Interviews 



3-2. Were there changes to the plan? 



Staff Interviews 
Monitoring Reports 



3-3. Could/should telephones be added to 
classrooms on other campuses? 

3-4. What is the cost per campus of implementing 
telephones in each classroom? 



Staff Interviews 



Finance Records 



T'6 



ERIC 



Ml 



Distribution of Reports 
For Instructional Personnel 



• Systemwide Testing U-2 

• Chapter 1/Chapter 1 Migrant U-16 

• Surveys U-17 

• Dropout Prevention U-20 



u-i 



90.07 



ITBS 

Individual Student Reports 
Elementary, 
Grades 1-6, 
Spring Administration 

All FTBS materials and reporis are sent directly to the priocipal at each school. 



Report 


Number of Ct^ies and Redpient 




Alpha Listing 

Urucs i-o 


2 Schools 

1 Sitnervi^ra' of Pwcholocical 

Services 
3 Total 




Percentile Rank Order 

LfisQCS i*0 

• Reading Comfm^hcnsion 

• Language TcHa! 

• Mathematics Total 


2 Schools 




Student Score Label (gummed) 
Includes G£ and pencenliles 


1 Schools 

(for measurement data card) 




Acnicycmcni Drucnyrc 
Persmalized fc^ each 
student (includes their percentiles 
scores) 


1 Schools 
(fcff parents) 




Alpha listing of fiflfa and sixth 
graders assigned to middle schools 
and Junior highs 


2 Schools 

(Middlc/JuniOT High) 




Classroom Summaries 

Dclivcrtd the beginning of next 
fall 


Upon Request 




Rank Order Listing of fifth and 
sixth graders 

Assigned by their campis (or 

next year 

• Reading Comprehension 

• Language Total 

• Mathematics Total 


2 Middle/Iunk)r high schools 





DISTRIB UTION 
O F 

REPORTS 
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DISTRIBUTION 
O F 

REPORTS 



ITBS 
Elementary, 
(Continued) 



All ITBS mtfehals ami rqxms are sent directly to the {^incipal at each ^rhool. 


Report 


Number of Copies and Recipient 




Alpbab^k Listing of Special 
Educatira Studeots 

Includes somes of all special 
^tK:mk)n stiKleiits tested (validly 
and experience only) 


2 Special Education 
Coordinators 




Individual Student Report 

This is genoated for each ^xxial 
education student 


1 Special Education 
Coordinates 




Alphabetic Listing of A uditorially 
Handicapped (AH) Students 
Includes scofcs of all awiitorially 
handicapped stu<tents tested 
(validly and for experience only) 


1 Supervisor, Regional Day 
School for the Deaf 




Alphabetic Listing of V dually 
Handicapped (VH) Students 


1 VH Teacher 





Includes scores of all vistialty 
handicapped ^u(tents t^ted 
(validly and for experieiKC only) 



■ — ^ 

r ^ 



90.07 



DISTRIBUTION 


ITBS 


O F 


Individual Student Repom 


REPORTS 


Middle School ^md Junior High, 




Grades 6-8, 



Spring Administration 



All ITBS materials and iqx»ts are sent directly to the fwincipal at each sdKwl. 



Report 


Number of Copies and Redpient 




Alpha Listing 

Listed by sdK^ol and grade 


4 Schools 

(2 OTiginals, 2 carbons) 
1 Supervisor of 

Psychcdogical Services 

5 Total 




Percentile Raok Order 
Grades 6-8 

• Re^Kling Comiwchension 

• Language Total 

• Mathematics Total 


I >cnoois 




Classroom Summary Analysis 
This program is run in school, 
grade, and period of day order. 
It is delivenod at the end of the 
spring semester and at the begin- 
ning of the next fall and spring 
semesters. 


Available upon request 
from Data Services 




Student Score Labels (gummed) 

Tte school receives two c(^ies: 
one for nKrasurement data card and 
one for the pmnanent report card. 


2 Schools 




Achievement Brochure 
PerscHialized for each 
student (includes their 
peirentiles scores) 






Alphabetk Listing of Eighth 
Gradm 

This list is seated by the schools 
these studcTiis will attend the next 
fall 


2 High Schools 
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REPORTS 



ITBS 

Middle School and Junior High, 

(Continued) 



All UBS materials and reports are sent directly to tte {^incjpal at school. 


Report 


Number of Copies and Recipient 




Rank Order Listbig dt Fifth and 

Sixth Graders 

This list is sorted by the schools 
these students will attend the next 
fall. 

• Reading Comprchcnsicx) 

• Language Total 

• Mathematics Total 


2 Middle/Junior High 
Schools 




Alphabetic Lkting of Special 
Education Sttidents 

Includes soms of all special 
education students tested (validly 
and for expoience only) 


1 Schools 

2 Special Education 
Coordinators 

3 Total 




Alphabetic Listing of Non-Public 
School Students 

Includes scores for eighth graders 
not attending an AISD school. 


4 Secondary Instructional 
Coordinators 

1 Schools 

5 Total 




SccH-e Labels 

(gummed, brown and white) 
These labels are used to give 
permanent score rcccmis to the 
nonpublic schools^ 


1 Schools 




Alphabetic Listing of Previous 
Year's Fourth- and Fifth-Grade 
Scores 

This listing is for students assigned 
to middle schools ami junior high 
campuses for the next fall. 


4 Schools 




lodivMual Student Report 

This report is generated for all 
special ediK^ation students. 


1 Special Education 
Coordinator 





v-s 
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DISTRIBUTION 
O F 

REPORTS 



ITBS 

Middle School and Junior High, 

(Continued) 



All ITBS materials and reports are sent directly to the principal at each scIkwI. 



Report 



Alphabetic ListiDg of AwlitoriaUy 
Handicapped (AH) Special Educa- 
Uon StiHients 

Includes scons of all auditorially 
hffiKlicapped iftudenis tested 
(validly and for experience only) 



Alphabetic Listing of Visually 
Handicapped (VH) Students 
Includes sccHts of all visually 
handicapped studoits t^tcd 
(validly and for expaiencc wily) 



Number of Copies and Recipient 



1 Supervisor, Regional Day 
School for the Deaf 



VH Teacher 




V 
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REPORTS 



TAP 

Individual Student Reports 
High Schools, 
Grades 9-12, 
Spring Administration 



All FFBS maiehals and rqx^ are sent dirccUy to the principal at each school 



Report 



Number Copies and Recipient 



Student Score Label 
(blue and white gummed) 

Individual student sccHies, 
alphabetic by school by grade. 



Achievement Brochure 

Personalized for each 
student (inclucks their 
pcrceniiles sccxx^s) 



Alphabetic Listing of Individual 
Student Scores 

This irport is generated by school 

by grade. 



Percentile Ranl& Order 

Grades 9-12 

• Reading Comprehension 

• Written ExfKession 

• Mathematics 



Alphabetic Listing of Special 
Education Students 

Includes sanies of all special 
education students tested (validly 
and for experience only) 



Fall Classroom Summaries 

This repcMt is generated by period, 
by teacher. 



Spring Classroom Summaries 
This repoft is generated by period, 
by teacher. 



Schools: 
1 Regi^rar 
1 Measurement Data Card 



Toiol 



1 Schools (for students) 



3 Schools 

1 SupervisOT of 

Psych(dogicaI Services 



Told 



School 



2 Special Education 
Coordinators 



Upon request by school 



Upcm reque^ by school 



ir,i 
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DISTRIBUTION 
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REPORTS 



TAP 

High Schools, 
(Continued) 



All ITBS msierials and reports are sent directly to the {sincipal at effi:h school. 



Report 



Individual Student Report for all 
Special Education Studeots 

Letter size document 



Alphabetic Listing of Audltorially 
Handicapped (AH) Special Educa- 
tion Students 

Includes scenes of all auditorially 
handicapped students te^ed 
(validly and f<x experioKe only) 



Alphabetic Listing of Visually 
Handicapped (VH) Students 
IiKludes scores of all visually 
handica{^)ed students tested 
(validly and for experience oily) 



Number of Cc^ies and Recipient 



1 



Schools 



1 Supervisor, Regional Day 
School for the Deaf 



VH Teacher 
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ITBS/TAP 

School and District Summary Reports 
Elementary and Secondary, 
Grades 1-12, 
Spring Administration 

All ITBS materials and rcpotts are sent directly to the {Hincipal at each school. 



Report 



Number ci Copfes and Recipient 



School Achievement Profiles 



^District Achievement Profiles 



Districtwide Frequency Distribution 
by Grade by Subt»t 



1 Schools 

9 Profiles volumes 



10 Total 



200-300 Final Report/ 

Profiles Volume 



1 



ORE 



• These reports arc not distribute to 
ANYONE until the final reports are 
distributed to the School Board. 



r <^ 
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DISTRIBUTION 
OF 

REPORTS 



TAAS 

Individual Student Reports 
Elementary and Secondary, 
Grades 1,3,5,7, 9, and 11 
Ck:tober Administration 



AU TAAS materials and reports are sent directly to the immnpal at each school. 



RepcMTt 



CoorKtofitial Stitdent RepoH 

(Provided by TEA) 



Student Score Labels (guranied) 

Indk^ates individual student scoxts, 
alphabetic listing by school by 
grade for measurement data cards 
(Proviikd by TEA) 



Alphabetic Listing of Individual 

Student Scores 

This report is delivered by school 
by gracte for valid (prodiK^ by 
TEA) and experience only 
(produced by ORE) 



Fall Classroom Summaries 
Grades4.6,8«andl0 



Numt>er of Ct^Mcs and Recipient 



1 Schools 
1 Par^ts 
1 Permanent Folder 



3 Total 

1 Shoots 

(2 copies for Grade 11) 



Schools 



Upon request from 
Data Services 



ERIC 
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DISTRIBUTION 
OF 

REPORTS 



lERlC 



TAAS 

School and District Summary Reports 
Elementary and Secondary, 
Grades 1, 3, 5, 7, 9, and 11 
October Administration 

All TAAS matexials and reports are sent directly to tiie {Hincipal at each sclwol. 



Report 



School Summary Report 

(Provided by TEA) 



* District Summary Report 

(Provicted by TEA) 



Distrtctwide Frequency Distribution 
by Grade by Subtest 



Alphabetic Listing of Students 
Required to Take the Exit-Level 
TAAS 

(Produced by ORE prior to testing) 



Mastery Report by Objective 
Gradesllandll 
(Produced by ORE) 



Class Summary by Objective 
At die b^inning of each semester by 
teacher by period (produced ORE) 



Number fjf Copies and Redptent 



T 



3 



Schools 

IiistnK:tiofial 

CoonlinaiOTS 

Associaie Sq)erintmdent 

of InstmctiOT 

Assistwt Superint^Hlent of 
Element^ Education (x 
Assi^mt Superintendent of 
Secondary Education 
ORE 



Total 



Final RepoaJ 
Achievement Profiles 

3 Instntctional 
Coordinators 

1 As^iate Siq)erintendent 
of Instruction 

1 Assi^ant Superintendent of 
Elementary Educati<Hi or 
Assistant Superintendent of 
Secondary Education 

1 ORE 



Toial 



ORE 



2 Schools 



Schools 

Instructional Comlin^tn 
Supovi^g Principals 
Total 



Upon request from 
Data Services 



Thcic ivpoftj fti^B od difS/ftuifid to 
ANYONE wdl the fioal tvpam uz 
dtarUKtfed to the Sdwol BomL 



U'll 
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DISTRIBUTION 
O F 

REPORTS 



ITBS/TAPyTAAS 
Special Education Coordinators Reports 
Elementary and Secondary, 
Grades 1-12 
Fall and Spring Administrations 



Report 



Alphabetic Listing of Special 
Education Students 

Includes scOTes of all special 
education students tested (validly 
and for expmeiK:e only) 



Alphabetic Listing of TA AS Scores 
These sst students whose $axc& 
are coded invalid - special 
education exemption by tt>e ARD. 



Number ti Copies and Recipient 



Grade 



Special Education 
Coofdinaiors 



M2 



Special Education 
Coordinators 



1.3.5.7. 
9,11 



ERIC 
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DISTRIBUTION 
O F 

REPORTS 



Other Tests 

School and District Summary Reports 
Elementary and Secondary, 
Grades 1-12 
Differing Administrations 



Report 


Number trf* Copies and Recipient 




Computer Literacy Test (CoLT) 
Alphabetic listing of students and 
their scores by current and 
destination schools. 


By Schools: 
2 Schools Where Tested 

Su^ght Alpha: 

14 Schools 
1 ORE 

15 Total 




Computer Literacy Test (CoLT) 
Rank order of students and their 
scoies by current and cfestination 
schools. 


By Schools: 
2 Schools WhCTC Tested 
2 Total 

Straight Alpha: 

14 Schools 
1 ORE 

15 Total 




TAAS Practice Tests 
Class summaries 


2 Schools 




End of Basal Tests 
Class summaries 
Individual Stalls Analysis 


Schools 
2 Class Summaries 
1 Individual Skills Analysis 




Rank-Order Listing of Black 
Students 

This list includes Black students at 
Teach and Re^ campuses 
scoring at or below the 50th 
percentile in reading and math- 
ematics on the s{^ng ITBS, by 
school (faU). 


1 Teach and Reach tether 





I erlc 
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DISTRIBUTION 
O F 

REPORTS 



Other Tests 
Elementary and Secondary, 
(Continued) 



Report 


Number of Copies and Redpient 




Classroom Nothis Analysis 

This repcHt lists Teach and Reach 
Audents served in reading and 
mathematics, by teacher and 

Customized Reports 


1 Teach and Reach tei^r 
Upon request 





ERJ.C 
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REPORTS 



Microfiche Production Schedule 

1990-91 



Test 

ITBS 

(ElOTtcntary and 
Middle/Junior High)** 



TAP 

(Senior High)** 



TAAS 

(Elaneniary, 
MiddJ^unior High, 
Senior High) 



Rep<Ht Target Date 

Districtwide alf^ listing of May 30 

individual stiKknt scores, gr^s 
1-8 — including special education 
students tested validly or for 
experience cmly 



Districtwide alpha listing of June 14 

individual student sc(ms, gr^es 
9-12 - irK:luding ^xxial education 
students tested validly or for 
experience <mly 



Districtwide alpha listing of June 14 

individual student scores 



One extra ^ of secondary alphabetic 
listings is produced iot the Science 
Academy. 
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REPORTS 



Chapter 1 /Chapter 1 Migrant 
School Staff Reports 



Report 


Number of Copies and Recipfent 




Chapter 1/Chapter 1 Migrant 
Roster and ROSS Forms 

These are sent in August and 
every six weeks. 


All ChaiMer 1 and Chapter 1 
Migrant teachers 




Chapter 1/Chapter 1 Migrant Final 
Reports 

These rqxKts are distributed in 
August 


All Chapter 1 and Chapter 1 
Migrant teachers 




Pre*K Test Results 

These results are sent in November 
and May. 


Pre-K tethers 




Other Analyses 

Other reports and computer 
generated reports sent upon 
request 


Program staff or Division of 
Elementary Education 




NCE Gains 

This information is sent out in 
August 


Chapter 1 and Priority School 
Principals 




EfTectiye Schook Standards 
Reports 

This repc»t is available and sent 
in June. 


All Elementary Principals 


1 
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Student Survey 
Staff Reports 



Report 


Number of Copies and Recipient 




VocatkHial Ccnirse Listing 

List of students* vocational course 
choices each hi^ school 


2 Vocational Counselors 




Sumniarv of Vocatkinfll Rp^doik^^ 
Summary results of student 
responses to the vocational items 
f(x e^h high school. 


2 Vocational Counselors 




List of Vocational Course Choices 
in Coop 

List of own and other students' 
vocational course choices for 
students interested in ooop, for 
each high school 


1 Set Vocational Counselors 




List of ail Survey Items and Results 
List of all survey items and results 
by campus 


1 Principals 





ERIC 
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Employee Survey 
Staff Reports 



Re{M>rt 


Number of Copies and Redpknt 




Summary Results of Items by Tc^k 
Summary results teactn^, 
administratCH-, and otho' profes- 
sional respond to survey items 
by tc^c 

List of School CUmate/EfTectiveness 
Items 

List of school climate/efTective- 
ness items and results by campus 


1 Originatcn' of the Items 
(iiKltKling evaluators, 
evaluaticxi as^iates, and 
central ofTice administra- 
tors) 

1 Principals 

1 Assistant Superintendent 

of Elementary Education 
1 Assistant Superintendent 

of Secondary EducaiicHi 





ERIC 
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Parent Survey 
Staff Reports 



Report 


Numl>er of Copies and Recipient 




Summary of Elementary Parent 
Responses 

Summary resulis of elemeniary 
parent responses to items 

Summary or Secondary Parent 
Responses 

Summary results of secondary 
parent responses to survey iiems 


1 Principals 
1 Assistant Superintendent 
of Elementary Education 

1 Assistant Superintendent 
of Secmdary EducaticMi 
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Dropout Prevention 
School Reports 
1990-91 



Report 


Number of Copies and Recipient 


Prodi^on 
Date 1 


New Students* Attendance 


By school: 


One week 


i^isting oi suKjCnts WIK7 arc 


1 Elementary and Secondary 


before school 


scheduled to attmd schools other 


Principals 


q)ens 


than the one they attended the 


1 InterventicNi Specialists 




previous year with mimber ami 


1 Elementary Cbunselors 




percent of days absent during the 


5 Secondary Counsel ws 




previous school year ami during 


1 Elementary aid Secondary 




the 6th six-weeks period each 


Drc^xxit IVevention 




year. 


Coordinators 




1 Elementary Supervising 






Principals 






CcMnplete Set to District Dropout 






Prevention Coordinator 






(Elementary and Secondary) 




Possible No Shows 


By school: 


End of 


Listing of students who are 


1 Elen^tary and Secondary 


second week 


scheduled to attend school who 


Drcqxxit PreventicMi 


of schocri 


have not yet attended with home 


Coordinators 




address. 


1 Elementary and Secondary 






Principals 






1 Registrars 






1 Intervention Specialists 






1 Set Gra<tes9-i?-DircctOT High 






Schocri Programs and Services 






1 Elemoitary Siq)^ising 






Principals 






1 SetGra(ks7-8Direcu^Middte 






School/Itmior High Programs 






and Services 






Complete Set to Distria I>nc^x>ut 






Prevention Coordinator 
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Dropout Prevention 
School Reports 
1990-91 
(Continued) 



Report 


Number of Copies and Recipient 


Production 
Date 


Infommtioo for Assessing Dn^Knit 


By school: 


Octi*cr 


Risk 


1 Etementffi^ i»id Secondary 




Listing studems in grades 1-12 


Dropout PtieventKHi 




with information of possible use in 


CooffdinatiHS 




ftfi<fi»^cina dmnr>iit nek 








Principals 






1 Int^vention Specialists 






1 Elementary Supervising 






FYincipals 






1 Elementary CounselcKS 






3 Sec(mdary Cotmselors 






1 SetGrades 9-12 Director High 






School Pkograms and Sovices 






1 Set Gra(tes 7-8 Directs Middle 






School/Junior High Programs 






and Services 






C mplete Set to District Dropout 






PteventicMi Coordinator 




Students at Risk for Dropping Out 


By school: 


November 


Listing students ui grades 7-12 


1 Elemoitary and Secondary 




identiiied by State criteria as at 


Dn^xxit PreventKMi 




risk of dit^ing out of school. 


Coordinators 




Similar list provided for grades 


1 Elemoitary and Secondary 






Principals 






1 InterventicNi Specialists 






5 CcHoiselors 






1 Elementary St)f)ervising 






Principals 






Cmiplete Set to Distria Dropout 






Prevention Coordinator 






1 Set Grades 1-6 Assistam 






Superintendent for Elemoitary 






Education 






1 Set Grades 9*12 Director High 






School Programs and Services 






1 Set Grcrks 7-8 Dirocto^ Middle 






SchoolJiBiior Hi^ Prc^rams 






and Sovii^ 






Complete Set to Superviiw 
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Dropout Prevention 
Secondary School Reports 

1990-91 



Report 


Number of Copies and Recipient 


Production 


Preliminary Report of Students at 


By »:hool: 


One week 


Risk for Dropping C^t 


1 SecofKiary Dropout Prevoition 


before school 


Lisung 01 suQcnts tn graocs /-ix 


r^nmliMtfVS 




identified by Slate crit^ as at 


1 Seccmdvy PriiKipals 




risk for dron>ing cnu of school. 


1 Intervcntk^i Specialists 




S Coiaiselors 






Complete Set lo District Dn^ut 






PiTvention Coordinates' 






1 Set Grwies 9-12 DtrectOT High 






School Pmgnuns and Services 






1 Set Grades 7-8 Diroctw Middle/ 






Juniw High Progrsffns and 






Services 






Complete Set to Siipervi»r Vision 






and Hearing Testing 




Preliminary Report of High Risk 


By school; 


September 


Students 


1 Sec^dary Principals 




Listing of enrolled students grades 


1 Sec(mdary Drx^XHit Prevention 




7-12 who are in the six categCKies 


Coordinators 




which are most associated with 


1 Inierventi(m Specialists 




dix^XHiis in {mvious years. 


S Counselors 






1 Set Grattes 9-12 Director High 






School Programs and Services 






1 Set Grades 7*8 IXrectCH^ Middle 






School/luni(»- High Ptogiams 






and Senrk^s 






Complete Set to District Dropcnit 






Preventim Coordin^ 






CcMnptete Set to Vocational 






Educatk>n Supervisee 
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Dropout Prevention 
Secondaiy School Reports 

1990-91 
(Continued) 



Report 


Number of Copies ^ xl Recipient 


Production 
Date 


High Risk Students 


By school: 


November 


Listing cf enrolled ^intents grades 


1 Secondary Principals 




7-12 who are in the six caiegories 


1 Secondary Drt^xnit Prevention 




which are most associated wiui 


Coordinators 




dropouts in i^vious years. 


1 IntervcnticHi Specialists 
5 CcHmselors 

1 Set Grades 9-12 Director High 

School Programs and Services 
1 Set Grades 7-8 Director Middle 

School/Iunior High Programs 

and Sm^iccs 
Comptete Set to Distria Drc^ut 

Prevention Coordinator 
Complete Set to Vocational 

Education Supervisor 




Parent Notification Attachment 


By school: 


November 


Listing TEA criteria marked for 


1 FcH^ Parents of Each At-Risk 




each criterkm that appli^ to an 


Student 




individual stu(tenL Mathematics 






and leading grnde equivalents also 






included. 






Six Weeks Dropout Report 


By school: 


End of each 


Listing of stu<tents who appear to 


1 Secondary Dropout Prevoiticm 


six weeks 


be dropouts consistent with the 


Coordinators 


period 


state dropcHit definition at the end 


1 Secmdary Principals 


of each six weeks. 


1 Registrars 

1 Int^voitiim Specialists 
Craiplete Set to Di^rict Drc^x^t 

Prevention Coordin^or 
1 Set Grades 9-12 Dinector High 

Schod Programs and Scnricts 
1 Set Grades 7-8 Director Middle 

School/IunicH- High Programs 

and Services 
5 Counselors 
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Dropout Summary 
Secondary School Reports 

1990-91 
(Continued) 



Report 


Number of Copies and Recipient 


Production 
1/aie 


SU-Week Dropout Report to 
Cabinet 
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Rqqueitfiwi by dMitoft» A fg |Jiti iw if iifliChooi«? 



Evviiisflon n#0d )d0n0fi6d by ORE? 
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